Jun 26 05:35:19 devstack cinder-volume[82648]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jun 26 05:35:19 devstack cinder-volume[82648]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 26 05:35:19 devstack cinder-volume[82648]: we strongly recommend against using it for new projects.
Jun 26 05:35:19 devstack cinder-volume[82648]: If you are already using Eventlet, we recommend migrating to a different
Jun 26 05:35:19 devstack cinder-volume[82648]: framework.  For more detail see
Jun 26 05:35:19 devstack cinder-volume[82648]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 26 05:35:19 devstack cinder-volume[82648]:   import eventlet  # noqa
Jun 26 05:35:22 devstack cinder-volume[82648]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82648) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 05:35:22 devstack cinder-volume[82648]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82648) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 05:35:22 devstack cinder-volume[82648]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82648) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 05:35:22 devstack cinder-volume[82648]: INFO dbcounter [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Registered counter for database cinder
Jun 26 05:35:22 devstack cinder-volume[82648]: DEBUG oslo_db.sqlalchemy.engines [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82648) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 05:35:23 devstack cinder-volume[82648]: DEBUG dbcounter [-] [82648] Writer thread running {{(pid=82648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 26 05:35:23 devstack cinder-volume[82648]: INFO cinder.rpc [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 26 05:35:23 devstack cinder-volume[82648]: INFO cinder.rpc [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 26 05:35:23 devstack cinder-volume[82648]: DEBUG oslo_db.sqlalchemy.engines [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82648) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 05:35:23 devstack cinder-volume[82648]: INFO cinder.volume.manager [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Determined volume DB was empty at startup.
Jun 26 05:35:23 devstack cinder-volume[82648]: DEBUG cinder.volume.manager [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82648) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 26 05:35:23 devstack cinder-volume[82648]: INFO cinder.volume.manager [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 26 05:35:23 devstack cinder-volume[82648]: WARNING stevedore.named [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 05:35:23 devstack cinder-volume[82648]: WARNING castellan.key_manager [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 05:35:23 devstack cinder-volume[82648]: WARNING cinder.keymgr.conf_key_mgr [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 05:35:23 devstack cinder-volume[82648]: DEBUG cinder.volume.drivers.lvm [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82648) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jun 26 05:35:23 devstack cinder-volume[82648]: DEBUG oslo_concurrency.processutils [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_concurrency.processutils [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] CMD "cinder-rtstool verify" returned: 0 in 0.476s {{(pid=82648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_db.sqlalchemy.engines [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82648) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 05:35:24 devstack cinder-volume[82648]: INFO cinder.rpc [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jun 26 05:35:24 devstack cinder-volume[82648]: INFO cinder.rpc [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jun 26 05:35:24 devstack cinder-volume[82648]: WARNING stevedore.named [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 05:35:24 devstack cinder-volume[82648]: WARNING castellan.key_manager [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 05:35:24 devstack cinder-volume[82648]: INFO cinder.volume.manager [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_db.sqlalchemy.engines [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82648) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 05:35:24 devstack cinder-volume[82648]: INFO oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Starting 1 workers
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Started child 82818 {{(pid=82648) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Full set of CONF: {{(pid=82648) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] ******************************************************************************** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Configuration options gathered from: {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] ================================================================================ {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] allow_availability_zone_fallback = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] allow_compression_on_image_upload = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] allowed_direct_url_schemes     = [] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] api_rate_limit                 = True {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] auth_strategy                  = keystone {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82818]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] az_cache_duration              = 3600 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_availability_zone      = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_host                   = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_name                   = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_stats_polling_interval = 60 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backup_api_class               = cinder.backup.api.API {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backup_name_template           = backup-%s {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backup_use_same_host           = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backup_use_temp_snapshot       = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] chap_password                  = **** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] chap_username                  =  {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cinder_internal_tenant_project_id = ec05ee08fdb84df78fa805a9a257d66f {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cinder_internal_tenant_user_id = ae09e0b0883f4e2ea57ffee98832a777 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cloned_volume_same_az          = True {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cluster                        = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] compression_format             = gzip {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] compute_api_class              = cinder.compute.nova.API {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] config_dir                     = [] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] config_source                  = [] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] control_exchange               = openstack {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] debug                          = True {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] default_availability_zone      = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] default_group_type             = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] default_volume_type            = lvmdriver-1 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] disk_geometry                  = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] driver_client_cert             = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] driver_client_cert_key         = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] driver_data_namespace          = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] driver_ssl_cert_path           = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] driver_ssl_cert_verify         = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] driver_use_ssl                 = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] enable_force_upload            = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] enable_new_services            = True {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] enable_unsupported_driver      = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] enabled_backends               = ['lvmdriver-1'] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] enforce_multipath_for_image_xfer = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] filter_function                = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] glance_api_insecure            = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] glance_api_servers             = ['http://192.168.122.132/image'] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] glance_api_ssl_compression     = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] glance_ca_certificates_file    = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] glance_catalog_info            = image:glance:publicURL {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] glance_certfile                = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] glance_keyfile                 = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] glance_num_retries             = 3 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] glance_request_timeout         = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] goodness_function              = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] graceful_shutdown_timeout      = 5 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] group_api_class                = cinder.group.api.API {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] host                           = devstack {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] image_compress_on_upload       = True {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] image_conversion_address_space_limit = 1 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] image_conversion_cpu_limit     = 60 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] image_conversion_disable       = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] image_upload_use_cinder_backend = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] image_upload_use_internal_tenant = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] image_volume_cache_enabled     = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] image_volume_cache_max_count   = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] image_volume_cache_max_size_gb = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] init_host_max_objects_retrieval = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] instance_format                = [instance: %(uuid)s]  {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] iscsi_target_flags             =  {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] iscsi_write_cache              = on {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] iser_helper                    = tgtadm {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] iser_ip_address                = 192.168.122.132 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] iser_port                      = 3260 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] log_color                      = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] log_config_append              = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] log_dir                        = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] log_file                       = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] log_options                    = True {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] log_rotate_interval            = 1 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] log_rotate_interval_type       = days {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] log_rotation_type              = none {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] max_age                        = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] max_logfile_count              = 30 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] max_logfile_size_mb            = 200 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] max_over_subscription_ratio    = 20.0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] message_reap_interval          = 86400 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] message_ttl                    = 2592000 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] migration_create_volume_timeout_secs = 300 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] monkey_patch                   = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] monkey_patch_modules           = [] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] my_ip                          = 192.168.122.132 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82818]: INFO cinder.volume.manager [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] no_snapshot_gb_quota           = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] num_iser_scan_tries            = 3 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] num_shell_tries                = 3 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] num_volume_device_scan_tries   = 3 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] nvmeof_conn_info_version       = 1 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] nvmet_ns_id                    = 10 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] nvmet_port_id                  = 1 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] osapi_max_limit                = 1000 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] osapi_volume_ext_list          = [] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] osapi_volume_listen_port       = 8776 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] osapi_volume_use_ssl           = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] osapi_volume_workers           = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] per_volume_size_limit          = -1 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] periodic_fuzzy_delay           = 60 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] periodic_interval              = 60 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] public_endpoint                = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] publish_errors                 = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] quota_backup_gigabytes         = 1000 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] quota_backups                  = 10 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] quota_gigabytes                = 1000 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] quota_groups                   = 10 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] quota_snapshots                = 10 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] quota_volumes                  = 10 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] rate_limit_burst               = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] rate_limit_except_level        = CRITICAL {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] rate_limit_interval            = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] reinit_driver_count            = 3 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] replication_device             = **** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] report_discard_supported       = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] report_interval                = 120 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] reservation_clean_interval     = 86400 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] reservation_expire             = 86400 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] reserved_image_namespaces      = [] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] reserved_percentage            = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] rpc_response_timeout           = 120 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] run_external_periodic_tasks    = True {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] scst_target_driver             = iscsi {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] scst_target_iqn_name           = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] service_down_time              = 720 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] shell_completion               = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] snapshot_name_template         = snapshot-%s {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] snapshot_same_host             = True {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] split_loggers                  = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] state_path                     = /opt/stack/data/cinder {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] storage_availability_zone      = nova {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] storage_protocol               = iSCSI {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] syslog_log_facility            = LOG_USER {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] target_helper                  = lioadm {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] target_ip_address              = 192.168.122.132 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] target_port                    = 3260 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] target_protocol                = iscsi {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] target_secondary_ip_addresses  = [] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] trace_flags                    = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] transport_url                  = **** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] until_refresh                  = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] use_chap_auth                  = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] use_default_quota_class        = True {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] use_journal                    = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] use_json                       = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] use_multipath_for_image_xfer   = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] use_stderr                     = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] use_syslog                     = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] verify_glance_signatures       = enabled {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] volume_api_class               = cinder.volume.api.API {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] volume_backend_name            = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] volume_clear                   = zero {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] volume_clear_ionice            = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] volume_clear_size              = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] volume_copy_bps_limit          = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] volume_dd_blocksize            = 1M {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] volume_name_template           = volume-%s {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] volume_service_inithost_offload = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] volume_usage_audit_period      = month {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] zoning_mode                    = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_concurrency.disable_process_locking = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.auth_section = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.auth_type   = password {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.auth_version = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.cache       = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.certfile    = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.delay_auth_decision = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.http_connect_timeout = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.include_service_catalog = True {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.insecure    = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.interface   = public {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.keyfile     = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.memcache_password =  {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.memcache_username =  {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.region_name = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.service_token_roles_required = True {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.service_type = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.token_cache_time = 300 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.132/identity {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.backend                  = dogpile.cache.null {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.backend_argument         = **** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.backend_expiration_time  = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.config_prefix            = cache.oslo {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.debug_cache_backend      = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.enable_retry_client      = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.enable_socket_keepalive  = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.enabled                  = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.expiration_time          = 600 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.hashclient_retry_attempts = 2 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.memcache_dead_retry      = 300 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.memcache_pool_maxsize    = 10 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.memcache_sasl_enabled    = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.password                 = **** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.proxies                  = [] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.redis_db                 = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.redis_sentinel_service_name = mymaster {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.redis_server             = localhost:6379 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.retry_attempts           = 2 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.retry_delay              = 0.0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.socket_keepalive_count   = 1 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.socket_keepalive_idle    = 1 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.socket_keepalive_interval = 1 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.socket_timeout           = 1.0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.tls_allowed_ciphers      = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.tls_cafile               = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.tls_certfile             = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.tls_enabled              = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.tls_keyfile              = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cache.username                 = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] coordination.backend_url       = **** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.asyncio_connection    = **** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.asyncio_slave_connection = **** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.backend               = sqlalchemy {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.connection            = **** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.connection_debug      = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.connection_parameters =  {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.connection_recycle_time = 3600 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.connection_trace      = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.db_inc_retry_interval = True {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.db_max_retries        = 20 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.db_max_retry_interval = 10 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.db_retry_interval     = 1 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.max_overflow          = 50 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.max_pool_size         = 5 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.max_retries           = 10 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.mysql_wsrep_sync_wait = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.pool_timeout          = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.retry_interval        = 10 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.slave_connection      = **** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.sqlite_synchronous    = True {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.synchronous_reader    = True {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] database.use_db_reconnect      = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] profiler.connection_string     = messaging:// {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] profiler.enabled               = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] profiler.es_doc_type           = notification {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] profiler.es_scroll_size        = 10000 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] profiler.es_scroll_time        = 2m {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] profiler.filter_error_trace    = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] profiler.hmac_keys             = **** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] profiler.sentinel_service_name = mymaster {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] profiler.socket_timeout        = 0.1 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.049s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] profiler.trace_requests        = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] profiler.trace_sqlalchemy      = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] profiler_jaeger.process_tags   = {} {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] profiler_jaeger.service_name_prefix = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] profiler_otlp.service_name_prefix = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_policy.enforce_new_defaults = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: WARNING oslo_config.cfg [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_policy.enforce_scope      = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_policy.policy_default_rule = default {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_policy.policy_file        = policy.yaml {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] privsep_osbrick.group          = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] privsep_osbrick.helper_command = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] privsep_osbrick.user           = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cinder_sys_admin.group         = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cinder_sys_admin.helper_command = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] cinder_sys_admin.user          = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] service_user.auth_section      = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] service_user.auth_type         = password {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] service_user.cafile            = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] service_user.certfile          = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] service_user.collect_timing    = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] service_user.insecure          = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] service_user.keyfile           = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] service_user.send_service_user_token = True {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] service_user.split_loggers     = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] service_user.timeout           = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] glance.auth_section            = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] glance.auth_type               = password {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] glance.certfile                = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] glance.collect_timing          = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] glance.insecure                = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] glance.keyfile                 = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] glance.region_name             = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] glance.split_loggers           = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] glance.timeout                 = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.backend_availability_zone = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.chap_password = **** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.chap_username =  {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.disk_geometry = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.driver_client_cert = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.driver_client_cert_key = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.driver_data_namespace = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.driver_use_ssl = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.enable_unsupported_driver = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.extra_capabilities = {} {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.filter_function = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.goodness_function = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.iscsi_target_flags =  {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.iscsi_write_cache = on {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.iser_helper   = tgtadm {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.iser_ip_address = 192.168.122.132 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.iser_port     = 3260 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.lvm_mirrors   = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.lvm_share_target = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.lvm_type      = auto {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.num_shell_tries = 3 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.nvmet_port_id = 1 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.replication_device = **** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.report_discard_supported = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.reserved_percentage = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.scst_target_driver = iscsi {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.scst_target_iqn_name = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.storage_protocol = iSCSI {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.target_helper = tgtadm {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.target_ip_address = 192.168.122.132 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.target_port   = 3260 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.target_protocol = iscsi {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.trace_flags   = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.unique_fqdn_network = True {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.use_chap_auth = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.volume_backend_name = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.volume_clear  = zero {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.volume_clear_ionice = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.volume_clear_size = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.volume_group  = cinder-volumes {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_reports.file_event_handler = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_reports.log_dir           = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.backend_availability_zone = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.backend_host       = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.chap_password      = **** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.chap_username      = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.chiscsi_conf       = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.disk_geometry      = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.driver_client_cert = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.driver_data_namespace = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.driver_use_ssl     = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.extra_capabilities = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.filter_function    = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.goodness_function  = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.iser_helper        = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.iser_ip_address    = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.iser_port          = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.iser_target_prefix = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.lvm_conf_file      = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.lvm_mirrors        = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.lvm_share_target   = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.lvm_type           = auto {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack sudo[82823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.num_shell_tries    = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.nvmet_port_id      = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack sudo[82823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.replication_device = **** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.report_discard_supported = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.reserved_percentage = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.scst_target_driver = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.storage_protocol   = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.target_helper      = lioadm {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.target_ip_address  = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.target_port        = 3260 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.target_protocol    = iscsi {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.trace_flags        = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.use_chap_auth      = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.volume_clear       = zero {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.volume_clear_size  = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] lvmdriver-1.volumes_dir        = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.ssl      = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_notifications.driver = [] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_notifications.retry = -1 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] oslo_messaging_notifications.transport_url = **** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] key_manager.fixed_key          = **** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican.barbican_api_version  = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican.barbican_endpoint     = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican.barbican_endpoint_type = public {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican.barbican_region_name  = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican.cafile                = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican.certfile              = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican.collect_timing        = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican.insecure              = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican.keyfile               = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican.number_of_retries     = 60 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican.retry_delay           = 1 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican.send_service_user_token = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican.split_loggers         = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican.timeout               = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican.verify_ssl            = True {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican.verify_ssl_path       = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican_service_user.auth_section = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican_service_user.auth_type = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican_service_user.cafile   = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican_service_user.certfile = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican_service_user.collect_timing = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican_service_user.insecure = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican_service_user.keyfile  = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican_service_user.split_loggers = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] barbican_service_user.timeout  = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] vault.approle_role_id          = **** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] vault.approle_secret_id        = **** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] vault.kv_mountpoint            = secret {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] vault.kv_path                  = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] vault.kv_version               = 2 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] vault.namespace                = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] vault.root_token_id            = **** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] vault.ssl_ca_crt_file          = None {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] vault.timeout                  = 60.0 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] vault.use_ssl                  = False {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:35:24 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] ******************************************************************************** {{(pid=82648) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jun 26 05:35:25 devstack sudo[82823]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:25 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.710s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:25 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:25 devstack sudo[83058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 05:35:25 devstack sudo[83058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:25 devstack sudo[83058]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:25 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.692s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:25 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 05:35:25 devstack cinder-volume[82818]: INFO cinder.brick.local_dev.lvm [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jun 26 05:35:25 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:25 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:25 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:25 devstack sudo[83294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 26 05:35:25 devstack sudo[83294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:26 devstack sudo[83294]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:26 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.728s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:26 devstack cinder-volume[82818]: DEBUG cinder.brick.local_dev.lvm [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82818) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jun 26 05:35:26 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:26 devstack sudo[83439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 05:35:26 devstack sudo[83439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:27 devstack sudo[83439]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:27 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.026s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:27 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:27 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:27 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:27 devstack sudo[83594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 05:35:27 devstack sudo[83594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:28 devstack sudo[83594]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:28 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.710s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:28 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:28 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:28 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:28 devstack sudo[83600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jun 26 05:35:28 devstack sudo[83600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:29 devstack sudo[83600]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:29 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.664s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:29 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:29 devstack sudo[83604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 26 05:35:29 devstack sudo[83604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:29 devstack sudo[83604]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:29 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.678s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:29 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:29 devstack sudo[83614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 26 05:35:29 devstack sudo[83614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:30 devstack sudo[83614]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:30 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.821s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:30 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:30 devstack sudo[83620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 05:35:30 devstack sudo[83620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:31 devstack sudo[83620]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:31 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.851s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:31 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:31 devstack sudo[83626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 05:35:31 devstack sudo[83626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:32 devstack sudo[83626]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:32 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.681s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:32 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:32 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:32 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:32 devstack sudo[83634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 05:35:32 devstack sudo[83634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:32 devstack sudo[83634]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:32 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.697s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:32 devstack cinder-volume[82818]: INFO cinder.volume.drivers.lvm [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jun 26 05:35:32 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:32 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:32 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:32 devstack sudo[83644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 05:35:32 devstack sudo[83644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:33 devstack sudo[83644]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:33 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.753s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:33 devstack cinder-volume[82818]: DEBUG cinder.volume.drivers.lvm [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Updating volume stats {{(pid=82818) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 26 05:35:33 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:33 devstack sudo[83760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 26 05:35:33 devstack sudo[83760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:34 devstack sudo[83760]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:34 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:34 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:34 devstack sudo[83900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 05:35:34 devstack sudo[83900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:34 devstack cinder-volume[82648]: DEBUG dbcounter [-] [82648] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:35:34 devstack sudo[83900]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:34 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:34 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:34 devstack sudo[83904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 05:35:34 devstack sudo[83904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:35 devstack sudo[83904]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:35 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.620s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:35 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:35 devstack sudo[83907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 05:35:35 devstack sudo[83907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:36 devstack sudo[83907]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:36 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:36 devstack cinder-volume[82818]: INFO cinder.volume.driver [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Driver hasn't implemented _init_vendor_properties()
Jun 26 05:35:36 devstack cinder-volume[82818]: DEBUG cinder.volume.driver [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82818) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 26 05:35:36 devstack cinder-volume[82818]: DEBUG oslo_db.sqlalchemy.engines [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82818) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 05:35:36 devstack cinder-volume[82818]: DEBUG dbcounter [-] [82818] Writer thread running {{(pid=82818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 26 05:35:36 devstack cinder-volume[82818]: DEBUG cinder.db.api [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Building query based on filter {{(pid=82818) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jun 26 05:35:36 devstack cinder-volume[82818]: DEBUG cinder.image.image_utils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82818) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 26 05:35:36 devstack cinder-volume[82818]: INFO cinder.keymgr.migration [None req-62511a20-168b-4c66-899f-c2593d661e7c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 26 05:35:36 devstack cinder-volume[82818]: DEBUG cinder.volume.drivers.lvm [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Updating volume stats {{(pid=82818) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 26 05:35:36 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:36 devstack sudo[83912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 26 05:35:36 devstack sudo[83912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:36 devstack sudo[83912]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:36 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:36 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:36 devstack sudo[83918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 05:35:36 devstack sudo[83918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:37 devstack sudo[83918]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:37 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:37 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:37 devstack sudo[83922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 05:35:37 devstack sudo[83922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:38 devstack sudo[83922]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:38 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.666s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:38 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:38 devstack sudo[83926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 05:35:38 devstack sudo[83926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:38 devstack sudo[83926]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:38 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:38 devstack cinder-volume[82818]: DEBUG cinder.manager [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Notifying Schedulers of capabilities ... {{(pid=82818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:35:38 devstack cinder-volume[82818]: INFO cinder.volume.manager [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Driver initialization completed successfully.
Jun 26 05:35:38 devstack cinder-volume[82818]: INFO cinder.manager [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Initiating service 2 cleanup
Jun 26 05:35:38 devstack cinder-volume[82818]: INFO cinder.manager [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Service 2 cleanup completed.
Jun 26 05:35:38 devstack cinder-volume[82818]: DEBUG cinder.service [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Creating RPC server for service cinder-volume {{(pid=82818) start /opt/stack/cinder/cinder/service.py:231}}
Jun 26 05:35:38 devstack cinder-volume[82818]: DEBUG cinder.service [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82818) start /opt/stack/cinder/cinder/service.py:237}}
Jun 26 05:35:39 devstack cinder-volume[82818]: INFO cinder.volume.manager [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jun 26 05:35:39 devstack cinder-volume[82818]: DEBUG cinder.volume.drivers.lvm [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Updating volume stats {{(pid=82818) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 26 05:35:39 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:39 devstack sudo[83930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 26 05:35:39 devstack sudo[83930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:39 devstack sudo[83930]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:39 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:39 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:39 devstack sudo[83933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 05:35:39 devstack sudo[83933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:40 devstack sudo[83933]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:40 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:40 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:40 devstack sudo[83993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 05:35:40 devstack sudo[83993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:41 devstack sudo[83993]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:41 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.625s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:41 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:35:41 devstack sudo[83997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 05:35:41 devstack sudo[83997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:35:41 devstack sudo[83997]: pam_unix(sudo:session): session closed for user root
Jun 26 05:35:41 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:35:41 devstack cinder-volume[82818]: INFO cinder.volume.manager [None req-2d7d3fff-5285-4439-a88f-bc22faebe36b None None] Driver post RPC initialization completed successfully.
Jun 26 05:35:51 devstack cinder-volume[82818]: DEBUG dbcounter [-] [82818] Writing DB stats cinder:SELECT=4 {{(pid=82818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:35:51 devstack cinder-volume[82818]: DEBUG dbcounter [-] [82818] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:36:01 devstack cinder-volume[82818]: DEBUG oslo_service.periodic_task [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running periodic task VolumeManager._thread_info {{(pid=82818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:36:01 devstack cinder-volume[82818]: DEBUG cinder.volume.manager [None req-40474171-d1bd-4df5-8227-29657a43941e None None] thread count: 6 {{(pid=82818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:36:01 devstack cinder-volume[82818]: DEBUG cinder.volume.manager [None req-40474171-d1bd-4df5-8227-29657a43941e None None] thread info: [<_MainThread(MainThread, started 127732809236608)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732699481856)>, <Thread(Thread-3 (stat_writer), started daemon 127732698240640)>, <Thread(Rabbit-heartbeat, started daemon 127732697021184)>, <Thread(Thread-5 (_runner), started daemon 127732697155584)>, <Thread(Thread-7 (_runner), started daemon 127732697271104)>] {{(pid=82818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:37:01 devstack cinder-volume[82818]: DEBUG oslo_service.periodic_task [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:37:01 devstack cinder-volume[82818]: DEBUG cinder.volume.drivers.lvm [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Updating volume stats {{(pid=82818) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 26 05:37:01 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:37:01 devstack sudo[86312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 26 05:37:01 devstack sudo[86312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:37:02 devstack sudo[86312]: pam_unix(sudo:session): session closed for user root
Jun 26 05:37:02 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:37:02 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:37:02 devstack sudo[86323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 05:37:02 devstack sudo[86323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:37:02 devstack sudo[86323]: pam_unix(sudo:session): session closed for user root
Jun 26 05:37:02 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:37:02 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:37:03 devstack sudo[86326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 05:37:03 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:37:03 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root
Jun 26 05:37:03 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.631s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:37:03 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:37:03 devstack sudo[86329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 05:37:03 devstack sudo[86329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:37:04 devstack sudo[86329]: pam_unix(sudo:session): session closed for user root
Jun 26 05:37:04 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:37:04 devstack cinder-volume[82818]: DEBUG cinder.manager [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Notifying Schedulers of capabilities ... {{(pid=82818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:37:04 devstack cinder-volume[82818]: DEBUG oslo_service.periodic_task [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running periodic task VolumeManager._thread_info {{(pid=82818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:37:04 devstack cinder-volume[82818]: DEBUG cinder.volume.manager [None req-40474171-d1bd-4df5-8227-29657a43941e None None] thread count: 6 {{(pid=82818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:37:04 devstack cinder-volume[82818]: DEBUG cinder.volume.manager [None req-40474171-d1bd-4df5-8227-29657a43941e None None] thread info: [<_MainThread(MainThread, started 127732809236608)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732699481856)>, <Thread(Thread-3 (stat_writer), started daemon 127732698240640)>, <Thread(Rabbit-heartbeat, started daemon 127732697021184)>, <Thread(Thread-5 (_runner), started daemon 127732697155584)>, <Thread(Thread-7 (_runner), started daemon 127732697271104)>] {{(pid=82818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:37:51 devstack cinder-volume[82818]: DEBUG dbcounter [-] [82818] Writing DB stats cinder:SELECT=1 {{(pid=82818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:37:51 devstack cinder-volume[82818]: DEBUG dbcounter [-] [82818] Writing DB stats cinder:UPDATE=1 {{(pid=82818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:38:01 devstack cinder-volume[82818]: DEBUG oslo_service.periodic_task [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:38:01 devstack cinder-volume[82818]: DEBUG cinder.volume.drivers.lvm [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Updating volume stats {{(pid=82818) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 26 05:38:01 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:38:01 devstack sudo[89181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 26 05:38:01 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:38:02 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root
Jun 26 05:38:02 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:38:02 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:38:02 devstack sudo[89184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 05:38:02 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:38:02 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root
Jun 26 05:38:02 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:38:02 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:38:03 devstack sudo[89187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 05:38:03 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:38:03 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root
Jun 26 05:38:03 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.632s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:38:03 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:38:03 devstack sudo[89190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 05:38:03 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:38:04 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root
Jun 26 05:38:04 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:38:04 devstack cinder-volume[82818]: DEBUG cinder.manager [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Notifying Schedulers of capabilities ... {{(pid=82818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:38:04 devstack cinder-volume[82818]: DEBUG oslo_service.periodic_task [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running periodic task VolumeManager._thread_info {{(pid=82818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:38:04 devstack cinder-volume[82818]: DEBUG cinder.volume.manager [None req-40474171-d1bd-4df5-8227-29657a43941e None None] thread count: 6 {{(pid=82818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:38:04 devstack cinder-volume[82818]: DEBUG cinder.volume.manager [None req-40474171-d1bd-4df5-8227-29657a43941e None None] thread info: [<_MainThread(MainThread, started 127732809236608)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732699481856)>, <Thread(Thread-3 (stat_writer), started daemon 127732698240640)>, <Thread(Rabbit-heartbeat, started daemon 127732697021184)>, <Thread(Thread-5 (_runner), started daemon 127732697155584)>, <Thread(Thread-7 (_runner), started daemon 127732697271104)>] {{(pid=82818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:39:01 devstack cinder-volume[82818]: DEBUG oslo_service.periodic_task [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:39:01 devstack cinder-volume[82818]: DEBUG cinder.volume.drivers.lvm [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Updating volume stats {{(pid=82818) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 26 05:39:01 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:39:01 devstack sudo[91020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 26 05:39:01 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:39:02 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root
Jun 26 05:39:02 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:39:02 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:39:02 devstack sudo[91035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 05:39:02 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:39:02 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root
Jun 26 05:39:02 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:39:02 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:39:02 devstack sudo[91058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 05:39:02 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:39:03 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root
Jun 26 05:39:03 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.657s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:39:03 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:39:03 devstack sudo[91076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 05:39:03 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:39:04 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root
Jun 26 05:39:04 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:39:04 devstack cinder-volume[82818]: DEBUG cinder.manager [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Notifying Schedulers of capabilities ... {{(pid=82818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:39:04 devstack cinder-volume[82818]: DEBUG oslo_service.periodic_task [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running periodic task VolumeManager._thread_info {{(pid=82818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:39:04 devstack cinder-volume[82818]: DEBUG cinder.volume.manager [None req-40474171-d1bd-4df5-8227-29657a43941e None None] thread count: 6 {{(pid=82818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:39:04 devstack cinder-volume[82818]: DEBUG cinder.volume.manager [None req-40474171-d1bd-4df5-8227-29657a43941e None None] thread info: [<_MainThread(MainThread, started 127732809236608)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732699481856)>, <Thread(Thread-3 (stat_writer), started daemon 127732698240640)>, <Thread(Rabbit-heartbeat, started daemon 127732697021184)>, <Thread(Thread-5 (_runner), started daemon 127732697155584)>, <Thread(Thread-7 (_runner), started daemon 127732697271104)>] {{(pid=82818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:39:51 devstack cinder-volume[82818]: DEBUG dbcounter [-] [82818] Writing DB stats cinder:SELECT=1 {{(pid=82818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:39:51 devstack cinder-volume[82818]: DEBUG dbcounter [-] [82818] Writing DB stats cinder:UPDATE=1 {{(pid=82818) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:40:01 devstack cinder-volume[82818]: DEBUG oslo_service.periodic_task [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:40:01 devstack cinder-volume[82818]: DEBUG cinder.volume.drivers.lvm [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Updating volume stats {{(pid=82818) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 26 05:40:01 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:40:01 devstack sudo[92160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 26 05:40:01 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:40:02 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root
Jun 26 05:40:02 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:40:02 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:40:02 devstack sudo[92164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 05:40:02 devstack sudo[92164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:40:02 devstack sudo[92164]: pam_unix(sudo:session): session closed for user root
Jun 26 05:40:02 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:40:02 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:40:03 devstack sudo[92178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 26 05:40:03 devstack sudo[92178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:40:03 devstack sudo[92178]: pam_unix(sudo:session): session closed for user root
Jun 26 05:40:03 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.625s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:40:03 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:40:03 devstack sudo[92181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 26 05:40:03 devstack sudo[92181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:40:04 devstack sudo[92181]: pam_unix(sudo:session): session closed for user root
Jun 26 05:40:04 devstack cinder-volume[82818]: DEBUG oslo_concurrency.processutils [None req-40474171-d1bd-4df5-8227-29657a43941e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=82818) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:40:04 devstack cinder-volume[82818]: DEBUG cinder.manager [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Notifying Schedulers of capabilities ... {{(pid=82818) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:40:04 devstack cinder-volume[82818]: DEBUG oslo_service.periodic_task [None req-40474171-d1bd-4df5-8227-29657a43941e None None] Running periodic task VolumeManager._thread_info {{(pid=82818) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:40:04 devstack cinder-volume[82818]: DEBUG cinder.volume.manager [None req-40474171-d1bd-4df5-8227-29657a43941e None None] thread count: 6 {{(pid=82818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:40:04 devstack cinder-volume[82818]: DEBUG cinder.volume.manager [None req-40474171-d1bd-4df5-8227-29657a43941e None None] thread info: [<_MainThread(MainThread, started 127732809236608)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732699481856)>, <Thread(Thread-3 (stat_writer), started daemon 127732698240640)>, <Thread(Rabbit-heartbeat, started daemon 127732697021184)>, <Thread(Thread-5 (_runner), started daemon 127732697155584)>, <Thread(Thread-7 (_runner), started daemon 127732697271104)>] {{(pid=82818) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:40:26 devstack cinder-volume[82648]: INFO oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Caught SIGTERM, stopping children
Jun 26 05:40:26 devstack cinder-volume[82648]: DEBUG oslo_concurrency.lockutils [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Acquiring lock "singleton_lock" {{(pid=82648) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 05:40:26 devstack cinder-volume[82648]: DEBUG oslo_concurrency.lockutils [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Acquired lock "singleton_lock" {{(pid=82648) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 05:40:26 devstack cinder-volume[82648]: DEBUG oslo_concurrency.lockutils [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Releasing lock "singleton_lock" {{(pid=82648) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 05:40:26 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Stop services. {{(pid=82648) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 26 05:40:26 devstack cinder-volume[82648]: DEBUG oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Killing children. {{(pid=82648) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 26 05:40:26 devstack cinder-volume[82648]: INFO oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Waiting on 1 children to exit
Jun 26 05:40:29 devstack cinder-volume[82818]: DEBUG oslo_concurrency.lockutils [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Acquiring lock "singleton_lock" {{(pid=82818) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 05:40:29 devstack cinder-volume[82818]: DEBUG oslo_concurrency.lockutils [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Acquired lock "singleton_lock" {{(pid=82818) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 05:40:29 devstack cinder-volume[82818]: DEBUG oslo_concurrency.lockutils [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Releasing lock "singleton_lock" {{(pid=82818) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 05:40:29 devstack cinder-volume[82818]: WARNING amqp [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 26 05:40:29 devstack cinder-volume[82818]: WARNING amqp [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 26 05:40:29 devstack cinder-volume[82648]: INFO oslo_service.backend._eventlet.service [None req-5317beb6-c90e-414c-87b2-cd15748827ef None None] Child 82818 exited with status 0
Jun 26 05:40:29 devstack cinder-volume[92903]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jun 26 05:40:29 devstack cinder-volume[92903]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 26 05:40:29 devstack cinder-volume[92903]: we strongly recommend against using it for new projects.
Jun 26 05:40:29 devstack cinder-volume[92903]: If you are already using Eventlet, we recommend migrating to a different
Jun 26 05:40:29 devstack cinder-volume[92903]: framework.  For more detail see
Jun 26 05:40:29 devstack cinder-volume[92903]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 26 05:40:29 devstack cinder-volume[92903]:   import eventlet  # noqa
Jun 26 05:40:31 devstack cinder-volume[92903]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92903) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 05:40:31 devstack cinder-volume[92903]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92903) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 05:40:31 devstack cinder-volume[92903]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92903) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 05:40:32 devstack cinder-volume[92903]: INFO dbcounter [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Registered counter for database cinder
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_db.sqlalchemy.engines [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92903) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG dbcounter [-] [92903] Writer thread running {{(pid=92903) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 26 05:40:32 devstack cinder-volume[92903]: INFO cinder.rpc [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 26 05:40:32 devstack cinder-volume[92903]: INFO cinder.rpc [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_db.sqlalchemy.engines [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92903) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 05:40:32 devstack cinder-volume[92903]: INFO cinder.volume.manager [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Determined volume DB was empty at startup.
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG cinder.volume.manager [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92903) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 26 05:40:32 devstack cinder-volume[92903]: INFO cinder.volume.manager [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 26 05:40:32 devstack cinder-volume[92903]: WARNING stevedore.named [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 05:40:32 devstack cinder-volume[92903]: WARNING castellan.key_manager [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 05:40:32 devstack cinder-volume[92903]: WARNING cinder.keymgr.conf_key_mgr [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 05:40:32 devstack cinder-volume[92903]: INFO cinder.volume.manager [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_db.sqlalchemy.engines [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92903) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 05:40:32 devstack cinder-volume[92903]: INFO oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Starting 1 workers
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Started child 93119 {{(pid=92903) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Full set of CONF: {{(pid=92903) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] ******************************************************************************** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Configuration options gathered from: {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] ================================================================================ {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] allow_availability_zone_fallback = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] allow_compression_on_image_upload = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] allowed_direct_url_schemes     = [] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] api_rate_limit                 = True {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] auth_strategy                  = keystone {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_availability_zone      = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_host                   = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_name                   = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_stats_polling_interval = 60 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backup_api_class               = cinder.backup.api.API {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backup_name_template           = backup-%s {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backup_use_same_host           = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backup_use_temp_snapshot       = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] chap_password                  = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] chap_username                  =  {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cinder_internal_tenant_project_id = ec05ee08fdb84df78fa805a9a257d66f {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cinder_internal_tenant_user_id = ae09e0b0883f4e2ea57ffee98832a777 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cluster                        = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] compression_format             = gzip {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] compute_api_class              = cinder.compute.nova.API {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] config_dir                     = [] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] config_source                  = [] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] control_exchange               = openstack {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] debug                          = True {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] default_availability_zone      = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] default_group_type             = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] default_volume_type            = QuobyteHD {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] disk_geometry                  = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] driver_client_cert             = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] driver_client_cert_key         = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] driver_data_namespace          = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] driver_ssl_cert_path           = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] driver_ssl_cert_verify         = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] driver_use_ssl                 = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] enable_new_services            = True {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] enable_unsupported_driver      = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] enabled_backends               = ['QuobyteHD'] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] enforce_multipath_for_image_xfer = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] filter_function                = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] glance_api_insecure            = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] glance_api_servers             = ['http://192.168.122.132/image'] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] glance_api_ssl_compression     = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] glance_ca_certificates_file    = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] glance_catalog_info            = image:glance:publicURL {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[93119]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] glance_certfile                = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] glance_keyfile                 = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] glance_num_retries             = 3 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] glance_request_timeout         = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] goodness_function              = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] graceful_shutdown_timeout      = 5 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] group_api_class                = cinder.group.api.API {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] host                           = devstack {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] image_compress_on_upload       = True {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] image_conversion_address_space_limit = 1 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:32 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] image_conversion_cpu_limit     = 60 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] image_conversion_disable       = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] image_upload_use_cinder_backend = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] image_upload_use_internal_tenant = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] image_volume_cache_enabled     = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] image_volume_cache_max_count   = 0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] image_volume_cache_max_size_gb = 0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] init_host_max_objects_retrieval = 0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] instance_format                = [instance: %(uuid)s]  {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] iscsi_target_flags             =  {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] iscsi_write_cache              = on {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] iser_helper                    = tgtadm {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] iser_ip_address                = 192.168.122.132 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] iser_port                      = 3260 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] log_color                      = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] log_config_append              = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] log_dir                        = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] log_file                       = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] log_options                    = True {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] log_rotate_interval            = 1 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] log_rotate_interval_type       = days {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] log_rotation_type              = none {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] max_age                        = 0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] max_logfile_count              = 30 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] max_logfile_size_mb            = 200 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] max_over_subscription_ratio    = 20.0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] message_reap_interval          = 86400 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] message_ttl                    = 2592000 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] migration_create_volume_timeout_secs = 300 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] monkey_patch                   = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] monkey_patch_modules           = [] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] my_ip                          = 192.168.122.132 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] no_snapshot_gb_quota           = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] num_iser_scan_tries            = 3 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] num_shell_tries                = 3 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] num_volume_device_scan_tries   = 3 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] nvmeof_conn_info_version       = 1 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] nvmet_ns_id                    = 10 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] nvmet_port_id                  = 1 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] osapi_max_limit                = 1000 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] osapi_volume_ext_list          = [] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] osapi_volume_listen            = 0.0.0.0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] osapi_volume_listen_port       = 8776 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] osapi_volume_use_ssl           = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] osapi_volume_workers           = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] per_volume_size_limit          = -1 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] periodic_fuzzy_delay           = 60 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] periodic_interval              = 60 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] project_id_regex               = [0-9a-f\-]+ {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] public_endpoint                = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] publish_errors                 = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] quota_backup_gigabytes         = 1000 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] quota_backups                  = 10 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] quota_gigabytes                = 1000 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] quota_groups                   = 10 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] quota_snapshots                = 10 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] quota_volumes                  = 10 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] rate_limit_burst               = 0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] rate_limit_except_level        = CRITICAL {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] rate_limit_interval            = 0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] reinit_driver_count            = 3 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] replication_device             = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] report_discard_supported       = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] report_interval                = 120 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] reservation_clean_interval     = 86400 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] reservation_expire             = 86400 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] reserved_image_namespaces      = [] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] reserved_percentage            = 0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] rpc_response_timeout           = 120 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] run_external_periodic_tasks    = True {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] scst_target_driver             = iscsi {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] scst_target_iqn_name           = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] service_down_time              = 720 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] shell_completion               = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] snapshot_name_template         = snapshot-%s {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] split_loggers                  = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] state_path                     = /opt/stack/data/cinder {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] storage_availability_zone      = nova {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] storage_protocol               = iSCSI {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] syslog_log_facility            = LOG_USER {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] target_helper                  = lioadm {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] target_ip_address              = 192.168.122.132 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] target_port                    = 3260 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] target_protocol                = iscsi {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] target_secondary_ip_addresses  = [] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] trace_flags                    = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] transfer_api_class             = cinder.transfer.api.API {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] transport_url                  = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] until_refresh                  = 0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] use_chap_auth                  = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] use_default_quota_class        = True {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] use_journal                    = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] use_json                       = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] use_multipath_for_image_xfer   = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] use_stderr                     = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] use_syslog                     = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] verify_glance_signatures       = enabled {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] volume_api_class               = cinder.volume.api.API {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] volume_backend_name            = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] volume_clear                   = zero {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] volume_clear_ionice            = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] volume_clear_size              = 0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] volume_copy_bps_limit          = 0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] volume_dd_blocksize            = 1M {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] volume_name_template           = volume-%s {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] volume_service_inithost_offload = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] volume_usage_audit_period      = month {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] zoning_mode                    = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:33 devstack cinder-volume[93119]: INFO cinder.volume.manager [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_concurrency.disable_process_locking = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[93119]: DEBUG cinder.volume.drivers.remotefs [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93119) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.auth_section = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.auth_type   = password {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.auth_version = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.cache       = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.certfile    = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.delay_auth_decision = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.http_connect_timeout = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.include_service_catalog = True {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.insecure    = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.interface   = public {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.keyfile     = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.memcache_password =  {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.memcache_username =  {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.region_name = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.service_token_roles_required = True {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.service_type = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.token_cache_time = 300 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.132/identity {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.backend                  = dogpile.cache.null {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.backend_argument         = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.backend_expiration_time  = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.config_prefix            = cache.oslo {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.debug_cache_backend      = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.enable_retry_client      = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.enable_socket_keepalive  = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.enabled                  = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.expiration_time          = 600 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.hashclient_retry_attempts = 2 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.memcache_dead_retry      = 300 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.memcache_pool_maxsize    = 10 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.memcache_sasl_enabled    = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.password                 = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.proxies                  = [] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.redis_db                 = 0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.redis_sentinel_service_name = mymaster {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.redis_server             = localhost:6379 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.retry_attempts           = 2 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.retry_delay              = 0.0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.socket_keepalive_count   = 1 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.socket_keepalive_idle    = 1 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.socket_keepalive_interval = 1 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.socket_timeout           = 1.0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.tls_allowed_ciphers      = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.tls_cafile               = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.tls_certfile             = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.tls_enabled              = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.tls_keyfile              = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cache.username                 = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] coordination.backend_url       = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.asyncio_connection    = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.asyncio_slave_connection = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.backend               = sqlalchemy {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.connection            = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.connection_debug      = 0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.connection_parameters =  {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.connection_recycle_time = 3600 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.connection_trace      = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.db_inc_retry_interval = True {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.db_max_retries        = 20 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.db_max_retry_interval = 10 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.db_retry_interval     = 1 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.max_overflow          = 50 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.max_pool_size         = 5 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.max_retries           = 10 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.mysql_wsrep_sync_wait = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.pool_timeout          = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.retry_interval        = 10 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.slave_connection      = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.sqlite_synchronous    = True {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.synchronous_reader    = True {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] database.use_db_reconnect      = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] profiler.connection_string     = messaging:// {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] profiler.enabled               = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] profiler.es_doc_type           = notification {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] profiler.es_scroll_size        = 10000 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] profiler.es_scroll_time        = 2m {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] profiler.filter_error_trace    = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] profiler.hmac_keys             = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] profiler.sentinel_service_name = mymaster {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] profiler.socket_timeout        = 0.1 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] profiler.trace_requests        = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] profiler.trace_sqlalchemy      = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] profiler_jaeger.process_tags   = {} {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] profiler_jaeger.service_name_prefix = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] profiler_otlp.service_name_prefix = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_policy.enforce_new_defaults = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: WARNING oslo_config.cfg [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_policy.enforce_scope      = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_policy.policy_default_rule = default {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_policy.policy_file        = policy.yaml {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_policy.remote_timeout     = 60.0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] privsep_osbrick.group          = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] privsep_osbrick.helper_command = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] privsep_osbrick.user           = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cinder_sys_admin.group         = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cinder_sys_admin.helper_command = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] cinder_sys_admin.user          = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] service_user.auth_section      = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] service_user.auth_type         = password {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] service_user.cafile            = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] service_user.certfile          = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] service_user.collect_timing    = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] service_user.insecure          = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] service_user.keyfile           = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] service_user.send_service_user_token = True {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] service_user.split_loggers     = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] service_user.timeout           = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] glance.auth_section            = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] glance.auth_type               = password {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] glance.certfile                = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] glance.collect_timing          = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] glance.insecure                = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] glance.keyfile                 = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] glance.region_name             = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] glance.split_loggers           = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] glance.timeout                 = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.backend_availability_zone = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.chap_password = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.chap_username =  {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.disk_geometry = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.driver_client_cert = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.driver_client_cert_key = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.driver_data_namespace = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.driver_use_ssl = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.enable_unsupported_driver = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.extra_capabilities = {} {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.filter_function = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.goodness_function = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.iscsi_target_flags =  {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.iscsi_write_cache = on {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.iser_helper   = tgtadm {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.iser_ip_address = 192.168.122.132 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.iser_port     = 3260 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.nas_host      =  {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.nas_login     = admin {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.nas_mount_options = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.nas_password  = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.nas_private_key =  {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.nas_share_path =  {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.nas_ssh_port  = 22 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.num_shell_tries = 3 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.nvmet_port_id = 1 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.quobyte_client_cfg = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.quobyte_volume_url = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.replication_device = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.report_discard_supported = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.reserved_percentage = 0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.scst_target_driver = iscsi {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.scst_target_iqn_name = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.storage_protocol = iSCSI {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.target_helper = tgtadm {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.target_ip_address = 192.168.122.132 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.target_port   = 3260 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.target_protocol = iscsi {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.trace_flags   = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.unique_fqdn_network = True {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.use_chap_auth = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.volume_backend_name = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.volume_clear  = zero {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.volume_clear_ionice = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.volume_clear_size = 0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_reports.file_event_handler = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_reports.log_dir           = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.backend_availability_zone = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.backend_host         = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.chap_password        = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.chap_username        = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.chiscsi_conf         = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.disk_geometry        = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.driver_client_cert   = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.driver_client_cert_key = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.driver_data_namespace = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.driver_use_ssl       = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.extra_capabilities   = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.filter_function      = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.goodness_function    = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.iscsi_target_flags   = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.iscsi_write_cache    = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.iser_helper          = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.iser_ip_address      = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.iser_port            = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.iser_target_prefix   = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.nas_host             = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.nas_login            = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.nas_mount_options    = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.nas_password         = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.nas_private_key      = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.nas_share_path       = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.nas_ssh_port         = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.num_shell_tries      = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.nvmet_ns_id          = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.nvmet_port_id        = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.replication_device   = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.report_discard_supported = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.reserved_percentage  = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.scst_target_driver   = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.storage_protocol     = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.target_helper        = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.target_ip_address    = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.target_port          = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.target_prefix        = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.target_protocol      = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.trace_flags          = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.unique_fqdn_network  = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.use_chap_auth        = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.volume_clear         = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.volume_clear_ionice  = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.volume_clear_size    = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] QuobyteHD.volumes_dir          = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.ssl      = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.ssl_version =  {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_notifications.driver = [] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_notifications.retry = -1 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] oslo_messaging_notifications.transport_url = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] key_manager.fixed_key          = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican.barbican_api_version  = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican.barbican_endpoint     = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican.barbican_endpoint_type = public {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican.barbican_region_name  = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican.cafile                = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican.certfile              = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican.collect_timing        = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican.insecure              = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican.keyfile               = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican.number_of_retries     = 60 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican.retry_delay           = 1 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican.send_service_user_token = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican.split_loggers         = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican.timeout               = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican.verify_ssl            = True {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican.verify_ssl_path       = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican_service_user.auth_section = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican_service_user.auth_type = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican_service_user.cafile   = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican_service_user.certfile = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican_service_user.collect_timing = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican_service_user.insecure = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican_service_user.keyfile  = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican_service_user.split_loggers = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] barbican_service_user.timeout  = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] vault.approle_role_id          = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] vault.approle_secret_id        = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] vault.kv_mountpoint            = secret {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] vault.kv_path                  = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] vault.kv_version               = 2 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] vault.namespace                = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] vault.root_token_id            = **** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] vault.ssl_ca_crt_file          = None {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] vault.timeout                  = 60.0 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] vault.use_ssl                  = False {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:33 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] ******************************************************************************** {{(pid=92903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jun 26 05:40:33 devstack cinder-volume[93119]: DEBUG cinder.volume.drivers.quobyte [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93119) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 26 05:40:33 devstack cinder-volume[93119]: WARNING cinder.volume.drivers.quobyte [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 26 05:40:33 devstack cinder-volume[93119]: WARNING cinder.volume.drivers.quobyte [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 26 05:40:33 devstack cinder-volume[93119]: DEBUG oslo_concurrency.processutils [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Running cmd (subprocess): mount.quobyte {{(pid=93119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:40:33 devstack quobyte-client[93124]: Reading configuration file: /etc/quobyte/client.cfg
Jun 26 05:40:33 devstack quobyte-client[93124]: Invalid parameters found, error: missing mount point.
Jun 26 05:40:33 devstack quobyte-client[93124]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jun 26 05:40:33 devstack quobyte-client[93124]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Jun 26 05:40:33 devstack cinder-volume[93119]: DEBUG oslo_concurrency.processutils [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] CMD "mount.quobyte" returned: 1 in 0.074s {{(pid=93119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:40:33 devstack cinder-volume[93119]: DEBUG oslo_concurrency.lockutils [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:40:33 devstack cinder-volume[93119]: DEBUG oslo_concurrency.lockutils [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:40:33 devstack cinder-volume[93119]: DEBUG cinder.volume.drivers.quobyte [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:40:33 devstack cinder-volume[93119]: INFO cinder.volume.drivers.quobyte [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 ...
Jun 26 05:40:33 devstack cinder-volume[93119]: DEBUG oslo_concurrency.processutils [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 -c /etc/quobyte/client-cinder.cfg {{(pid=93119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:40:33 devstack sudo[93125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 -c /etc/quobyte/client-cinder.cfg
Jun 26 05:40:33 devstack sudo[93125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:40:34 devstack sudo[93125]: pam_unix(sudo:session): session closed for user root
Jun 26 05:40:34 devstack cinder-volume[93119]: DEBUG oslo_concurrency.processutils [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.763s {{(pid=93119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:40:34 devstack cinder-volume[93119]: INFO cinder.volume.drivers.quobyte [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 succeeded
Jun 26 05:40:34 devstack cinder-volume[93119]: DEBUG cinder.volume.drivers.quobyte [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:40:34 devstack cinder-volume[93119]: DEBUG oslo_concurrency.lockutils [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.773s {{(pid=93119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:40:34 devstack cinder-volume[93119]: DEBUG oslo_concurrency.processutils [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:40:34 devstack sudo[93194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:40:34 devstack sudo[93194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:40:34 devstack sudo[93194]: pam_unix(sudo:session): session closed for user root
Jun 26 05:40:34 devstack cinder-volume[93119]: DEBUG oslo_concurrency.processutils [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.615s {{(pid=93119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:40:34 devstack cinder-volume[93119]: INFO cinder.volume.driver [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Driver hasn't implemented _init_vendor_properties()
Jun 26 05:40:34 devstack cinder-volume[93119]: DEBUG cinder.volume.driver [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93119) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 26 05:40:34 devstack cinder-volume[93119]: DEBUG oslo_db.sqlalchemy.engines [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93119) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 05:40:34 devstack cinder-volume[93119]: DEBUG dbcounter [-] [93119] Writer thread running {{(pid=93119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 26 05:40:34 devstack cinder-volume[93119]: DEBUG cinder.db.api [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Building query based on filter {{(pid=93119) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jun 26 05:40:34 devstack cinder-volume[93119]: DEBUG cinder.image.image_utils [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93119) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 26 05:40:34 devstack cinder-volume[93119]: INFO cinder.keymgr.migration [None req-bf9ff6e8-f6dc-4a60-bc0e-d70ceb2a0593 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 26 05:40:34 devstack cinder-volume[93119]: DEBUG oslo_concurrency.lockutils [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:40:34 devstack cinder-volume[93119]: DEBUG oslo_concurrency.lockutils [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:40:34 devstack cinder-volume[93119]: DEBUG cinder.volume.drivers.quobyte [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:40:34 devstack cinder-volume[93119]: DEBUG cinder.volume.drivers.quobyte [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:40:34 devstack cinder-volume[93119]: DEBUG oslo_concurrency.lockutils [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:40:34 devstack cinder-volume[93119]: DEBUG oslo_concurrency.processutils [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:40:34 devstack sudo[93197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:40:34 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:40:35 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root
Jun 26 05:40:35 devstack cinder-volume[93119]: DEBUG oslo_concurrency.processutils [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.625s {{(pid=93119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:40:35 devstack cinder-volume[93119]: DEBUG cinder.manager [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Notifying Schedulers of capabilities ... {{(pid=93119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:40:35 devstack cinder-volume[93119]: INFO cinder.volume.manager [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Driver initialization completed successfully.
Jun 26 05:40:35 devstack cinder-volume[93119]: INFO cinder.manager [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Initiating service 3 cleanup
Jun 26 05:40:35 devstack cinder-volume[93119]: INFO cinder.manager [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Service 3 cleanup completed.
Jun 26 05:40:35 devstack cinder-volume[93119]: DEBUG cinder.service [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Creating RPC server for service cinder-volume {{(pid=93119) start /opt/stack/cinder/cinder/service.py:231}}
Jun 26 05:40:35 devstack cinder-volume[93119]: DEBUG cinder.service [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93119) start /opt/stack/cinder/cinder/service.py:237}}
Jun 26 05:40:35 devstack cinder-volume[93119]: INFO cinder.volume.manager [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 26 05:40:35 devstack cinder-volume[93119]: DEBUG oslo_concurrency.lockutils [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:40:35 devstack cinder-volume[93119]: DEBUG oslo_concurrency.lockutils [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:40:35 devstack cinder-volume[93119]: DEBUG cinder.volume.drivers.quobyte [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:40:35 devstack cinder-volume[93119]: DEBUG cinder.volume.drivers.quobyte [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:40:35 devstack cinder-volume[93119]: DEBUG oslo_concurrency.lockutils [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:40:35 devstack cinder-volume[93119]: DEBUG oslo_concurrency.processutils [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:40:35 devstack sudo[93204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:40:35 devstack sudo[93204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:40:36 devstack sudo[93204]: pam_unix(sudo:session): session closed for user root
Jun 26 05:40:36 devstack cinder-volume[93119]: DEBUG oslo_concurrency.processutils [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.645s {{(pid=93119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:40:36 devstack cinder-volume[93119]: INFO cinder.volume.manager [None req-a2333d64-315c-40b5-b74d-9a91bfc72af2 None None] Driver post RPC initialization completed successfully.
Jun 26 05:40:40 devstack cinder-volume[93119]: DEBUG oslo_concurrency.lockutils [None req-2d929bc4-5ea3-40d0-bce0-d6eb298bb13d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:40:40 devstack cinder-volume[93119]: DEBUG oslo_concurrency.lockutils [None req-2d929bc4-5ea3-40d0-bce0-d6eb298bb13d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:40:40 devstack cinder-volume[93119]: DEBUG cinder.volume.drivers.quobyte [None req-2d929bc4-5ea3-40d0-bce0-d6eb298bb13d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:40:40 devstack cinder-volume[93119]: DEBUG cinder.volume.drivers.quobyte [None req-2d929bc4-5ea3-40d0-bce0-d6eb298bb13d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:40:40 devstack cinder-volume[93119]: DEBUG oslo_concurrency.lockutils [None req-2d929bc4-5ea3-40d0-bce0-d6eb298bb13d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:40:40 devstack cinder-volume[93119]: DEBUG oslo_concurrency.processutils [None req-2d929bc4-5ea3-40d0-bce0-d6eb298bb13d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:40:40 devstack sudo[93317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:40:40 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:40:40 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root
Jun 26 05:40:40 devstack cinder-volume[93119]: DEBUG oslo_concurrency.processutils [None req-2d929bc4-5ea3-40d0-bce0-d6eb298bb13d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.600s {{(pid=93119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:40:40 devstack cinder-volume[93119]: DEBUG cinder.manager [None req-2d929bc4-5ea3-40d0-bce0-d6eb298bb13d None None] Notifying Schedulers of capabilities ... {{(pid=93119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:40:42 devstack cinder-volume[92903]: DEBUG dbcounter [-] [92903] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=92903) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:40:43 devstack cinder-volume[92903]: INFO oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Caught SIGTERM, stopping children
Jun 26 05:40:43 devstack cinder-volume[92903]: DEBUG oslo_concurrency.lockutils [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Acquiring lock "singleton_lock" {{(pid=92903) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 05:40:43 devstack cinder-volume[92903]: DEBUG oslo_concurrency.lockutils [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Acquired lock "singleton_lock" {{(pid=92903) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 05:40:43 devstack cinder-volume[92903]: DEBUG oslo_concurrency.lockutils [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Releasing lock "singleton_lock" {{(pid=92903) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 05:40:43 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Stop services. {{(pid=92903) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 26 05:40:43 devstack cinder-volume[92903]: DEBUG oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Killing children. {{(pid=92903) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 26 05:40:43 devstack cinder-volume[92903]: INFO oslo_service.backend._eventlet.service [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Waiting on 1 children to exit
Jun 26 05:40:46 devstack cinder-volume[93119]: DEBUG dbcounter [-] [93119] Writing DB stats cinder:SELECT=4 {{(pid=93119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:40:46 devstack cinder-volume[93119]: DEBUG dbcounter [-] [93119] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=93119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:40:48 devstack cinder-volume[93119]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Jun 26 05:40:48 devstack cinder-volume[93409]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jun 26 05:40:48 devstack cinder-volume[93409]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 26 05:40:48 devstack cinder-volume[93409]: we strongly recommend against using it for new projects.
Jun 26 05:40:48 devstack cinder-volume[93409]: If you are already using Eventlet, we recommend migrating to a different
Jun 26 05:40:48 devstack cinder-volume[93409]: framework.  For more detail see
Jun 26 05:40:48 devstack cinder-volume[93409]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 26 05:40:48 devstack cinder-volume[93409]:   import eventlet  # noqa
Jun 26 05:40:48 devstack cinder-volume[93119]: DEBUG oslo_concurrency.lockutils [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Acquiring lock "singleton_lock" {{(pid=93119) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 05:40:48 devstack cinder-volume[93119]: DEBUG oslo_concurrency.lockutils [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Acquired lock "singleton_lock" {{(pid=93119) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 05:40:48 devstack cinder-volume[93119]: DEBUG oslo_concurrency.lockutils [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Releasing lock "singleton_lock" {{(pid=93119) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 05:40:48 devstack cinder-volume[93119]: WARNING amqp [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 26 05:40:48 devstack cinder-volume[93119]: WARNING amqp [None req-eafe0d00-3905-48a8-ad0a-b605e7c36aab None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 26 05:40:51 devstack cinder-volume[93409]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93409) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 05:40:51 devstack cinder-volume[93409]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93409) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 05:40:51 devstack cinder-volume[93409]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93409) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 05:40:51 devstack cinder-volume[93409]: INFO dbcounter [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] Registered counter for database cinder
Jun 26 05:40:51 devstack cinder-volume[93409]: DEBUG oslo_db.sqlalchemy.engines [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93409) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG dbcounter [-] [93409] Writer thread running {{(pid=93409) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 26 05:40:52 devstack cinder-volume[93409]: INFO cinder.rpc [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 26 05:40:52 devstack cinder-volume[93409]: INFO cinder.rpc [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_db.sqlalchemy.engines [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93409) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 05:40:52 devstack cinder-volume[93409]: INFO cinder.volume.manager [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] Determined volume DB was empty at startup.
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG cinder.volume.manager [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93409) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 26 05:40:52 devstack cinder-volume[93409]: WARNING stevedore.named [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 05:40:52 devstack cinder-volume[93409]: WARNING castellan.key_manager [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 05:40:52 devstack cinder-volume[93409]: WARNING cinder.keymgr.conf_key_mgr [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 05:40:52 devstack cinder-volume[93409]: INFO cinder.volume.manager [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_db.sqlalchemy.engines [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93409) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 05:40:52 devstack cinder-volume[93409]: INFO oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] Starting 1 workers
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] Started child 93708 {{(pid=93409) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] Full set of CONF: {{(pid=93409) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] ******************************************************************************** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] Configuration options gathered from: {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jun 26 05:40:52 devstack cinder-volume[93708]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] ================================================================================ {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] allow_availability_zone_fallback = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] allow_compression_on_image_upload = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] allowed_direct_url_schemes     = [] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] api_rate_limit                 = True {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] auth_strategy                  = keystone {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_availability_zone      = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_host                   = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_name                   = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_stats_polling_interval = 60 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backup_api_class               = cinder.backup.api.API {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backup_name_template           = backup-%s {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backup_use_same_host           = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backup_use_temp_snapshot       = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] chap_password                  = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] chap_username                  =  {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cinder_internal_tenant_project_id = ec05ee08fdb84df78fa805a9a257d66f {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cinder_internal_tenant_user_id = ae09e0b0883f4e2ea57ffee98832a777 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cluster                        = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] compression_format             = gzip {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] compute_api_class              = cinder.compute.nova.API {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] config_dir                     = [] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] config_source                  = [] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] control_exchange               = openstack {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] debug                          = True {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] default_availability_zone      = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] default_group_type             = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] default_volume_type            = QuobyteHD {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] disk_geometry                  = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] driver_client_cert             = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] driver_client_cert_key         = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] driver_data_namespace          = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] driver_ssl_cert_path           = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] driver_ssl_cert_verify         = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] driver_use_ssl                 = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] enable_new_services            = True {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] enable_unsupported_driver      = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] enabled_backends               = ['QuobyteHD'] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] enforce_multipath_for_image_xfer = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] filter_function                = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] glance_api_insecure            = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] glance_api_servers             = ['http://192.168.122.132/image'] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] glance_api_ssl_compression     = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 26 05:40:52 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93708) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] glance_ca_certificates_file    = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] glance_catalog_info            = image:glance:publicURL {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] glance_certfile                = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] glance_keyfile                 = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] glance_num_retries             = 3 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] glance_request_timeout         = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] goodness_function              = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] graceful_shutdown_timeout      = 5 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] group_api_class                = cinder.group.api.API {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] host                           = devstack {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] image_compress_on_upload       = True {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] image_conversion_address_space_limit = 1 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] image_conversion_cpu_limit     = 60 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] image_conversion_disable       = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] image_upload_use_cinder_backend = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] image_upload_use_internal_tenant = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] image_volume_cache_enabled     = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] image_volume_cache_max_count   = 0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] image_volume_cache_max_size_gb = 0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] init_host_max_objects_retrieval = 0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] instance_format                = [instance: %(uuid)s]  {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] iscsi_target_flags             =  {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] iscsi_write_cache              = on {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] iser_helper                    = tgtadm {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] iser_ip_address                = 192.168.122.132 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] iser_port                      = 3260 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] log_color                      = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] log_config_append              = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] log_dir                        = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] log_file                       = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] log_options                    = True {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] log_rotate_interval            = 1 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] log_rotate_interval_type       = days {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] log_rotation_type              = none {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] max_age                        = 0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] max_logfile_count              = 30 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] max_logfile_size_mb            = 200 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] max_over_subscription_ratio    = 20.0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] message_reap_interval          = 86400 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] message_ttl                    = 2592000 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] migration_create_volume_timeout_secs = 300 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] monkey_patch                   = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] monkey_patch_modules           = [] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] my_ip                          = 192.168.122.132 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] no_snapshot_gb_quota           = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] num_iser_scan_tries            = 3 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] num_shell_tries                = 3 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] num_volume_device_scan_tries   = 3 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] nvmeof_conn_info_version       = 1 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] nvmet_ns_id                    = 10 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] nvmet_port_id                  = 1 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] osapi_max_limit                = 1000 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] osapi_volume_ext_list          = [] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] osapi_volume_listen            = 0.0.0.0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] osapi_volume_listen_port       = 8776 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] osapi_volume_use_ssl           = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] osapi_volume_workers           = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] per_volume_size_limit          = -1 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] periodic_fuzzy_delay           = 60 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] periodic_interval              = 60 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] project_id_regex               = [0-9a-f\-]+ {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] public_endpoint                = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] publish_errors                 = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] quota_backup_gigabytes         = 1000 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] quota_backups                  = 10 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] quota_gigabytes                = 1000 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] quota_groups                   = 10 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] quota_snapshots                = 10 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] quota_volumes                  = 10 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] rate_limit_burst               = 0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] rate_limit_except_level        = CRITICAL {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] rate_limit_interval            = 0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] reinit_driver_count            = 3 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] replication_device             = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] report_discard_supported       = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] report_interval                = 120 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] reservation_clean_interval     = 86400 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] reservation_expire             = 86400 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] reserved_image_namespaces      = [] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] reserved_percentage            = 0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] rpc_response_timeout           = 120 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] run_external_periodic_tasks    = True {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] scst_target_driver             = iscsi {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] scst_target_iqn_name           = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] service_down_time              = 720 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] shell_completion               = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] snapshot_name_template         = snapshot-%s {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] split_loggers                  = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] state_path                     = /opt/stack/data/cinder {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] storage_availability_zone      = nova {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] storage_protocol               = iSCSI {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] syslog_log_facility            = LOG_USER {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] target_helper                  = lioadm {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] target_ip_address              = 192.168.122.132 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93708) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 26 05:40:52 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.quobyte [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] target_port                    = 3260 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] target_protocol                = iscsi {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.quobyte [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] target_secondary_ip_addresses  = [] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] trace_flags                    = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] transfer_api_class             = cinder.transfer.api.API {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] transport_url                  = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] until_refresh                  = 0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] use_chap_auth                  = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Running cmd (subprocess): mount.quobyte {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] use_default_quota_class        = True {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] use_journal                    = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] use_json                       = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] use_multipath_for_image_xfer   = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] use_stderr                     = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] use_syslog                     = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] verify_glance_signatures       = enabled {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] volume_api_class               = cinder.volume.api.API {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] volume_backend_name            = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] volume_clear                   = zero {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] volume_clear_ionice            = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] volume_clear_size              = 0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] volume_copy_bps_limit          = 0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] volume_dd_blocksize            = 1M {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] volume_name_template           = volume-%s {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] volume_service_inithost_offload = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] volume_usage_audit_period      = month {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] zoning_mode                    = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_concurrency.disable_process_locking = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.auth_section = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.auth_type   = password {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.auth_version = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.cache       = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.certfile    = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.delay_auth_decision = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.http_connect_timeout = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.include_service_catalog = True {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.insecure    = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.interface   = public {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.keyfile     = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.memcache_password =  {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.memcache_username =  {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.region_name = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.service_token_roles_required = True {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.service_type = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.token_cache_time = 300 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.132/identity {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.backend                  = dogpile.cache.null {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.backend_argument         = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.backend_expiration_time  = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.config_prefix            = cache.oslo {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.debug_cache_backend      = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.enable_retry_client      = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.enable_socket_keepalive  = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.enabled                  = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.expiration_time          = 600 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.hashclient_retry_attempts = 2 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.memcache_dead_retry      = 300 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.memcache_pool_maxsize    = 10 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.memcache_sasl_enabled    = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.password                 = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.proxies                  = [] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.redis_db                 = 0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.redis_sentinel_service_name = mymaster {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.redis_server             = localhost:6379 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.retry_attempts           = 2 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.retry_delay              = 0.0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.socket_keepalive_count   = 1 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.socket_keepalive_idle    = 1 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.socket_keepalive_interval = 1 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.socket_timeout           = 1.0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack quobyte-client[93709]: Reading configuration file: /etc/quobyte/client.cfg
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.tls_allowed_ciphers      = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.tls_cafile               = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.tls_certfile             = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack quobyte-client[93709]: Invalid parameters found, error: missing mount point.
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.tls_enabled              = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.tls_keyfile              = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cache.username                 = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack quobyte-client[93709]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] coordination.backend_url       = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.asyncio_connection    = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.asyncio_slave_connection = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.backend               = sqlalchemy {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.connection            = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.connection_debug      = 0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack quobyte-client[93709]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.connection_parameters =  {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.connection_recycle_time = 3600 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.connection_trace      = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.db_inc_retry_interval = True {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.db_max_retries        = 20 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.db_max_retry_interval = 10 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.db_retry_interval     = 1 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.max_overflow          = 50 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.max_pool_size         = 5 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.max_retries           = 10 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.mysql_wsrep_sync_wait = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.pool_timeout          = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.retry_interval        = 10 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.slave_connection      = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.sqlite_synchronous    = True {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.synchronous_reader    = True {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] database.use_db_reconnect      = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] CMD "mount.quobyte" returned: 1 in 0.078s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] profiler.connection_string     = messaging:// {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] profiler.enabled               = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] profiler.es_doc_type           = notification {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] profiler.es_scroll_size        = 10000 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] profiler.es_scroll_time        = 2m {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] profiler.filter_error_trace    = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] profiler.hmac_keys             = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] profiler.sentinel_service_name = mymaster {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] profiler.socket_timeout        = 0.1 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] profiler.trace_requests        = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] profiler.trace_sqlalchemy      = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] profiler_jaeger.process_tags   = {} {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] profiler_jaeger.service_name_prefix = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] profiler_otlp.service_name_prefix = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_policy.enforce_new_defaults = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: WARNING oslo_config.cfg [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_policy.enforce_scope      = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_policy.policy_default_rule = default {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_policy.policy_file        = policy.yaml {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:40:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_policy.remote_timeout     = 60.0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] privsep_osbrick.group          = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] privsep_osbrick.helper_command = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] privsep_osbrick.user           = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cinder_sys_admin.group         = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cinder_sys_admin.helper_command = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] cinder_sys_admin.user          = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] service_user.auth_section      = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] service_user.auth_type         = password {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] service_user.cafile            = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] service_user.certfile          = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] service_user.collect_timing    = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] service_user.insecure          = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] service_user.keyfile           = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] service_user.send_service_user_token = True {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] service_user.split_loggers     = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] service_user.timeout           = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] glance.auth_section            = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] glance.auth_type               = password {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] glance.certfile                = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] glance.collect_timing          = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] glance.insecure                = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] glance.keyfile                 = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] glance.region_name             = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] glance.split_loggers           = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] glance.timeout                 = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.backend_availability_zone = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.chap_password = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.chap_username =  {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.disk_geometry = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.driver_client_cert = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.driver_client_cert_key = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.driver_data_namespace = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.driver_use_ssl = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.enable_unsupported_driver = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack sudo[93710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:40:52 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.extra_capabilities = {} {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.filter_function = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.goodness_function = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.iscsi_target_flags =  {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.iscsi_write_cache = on {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.iser_helper   = tgtadm {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.iser_ip_address = 192.168.122.132 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.iser_port     = 3260 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.nas_host      =  {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.nas_login     = admin {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.nas_mount_options = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.nas_password  = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.nas_private_key =  {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.nas_share_path =  {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.nas_ssh_port  = 22 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.num_shell_tries = 3 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.nvmet_port_id = 1 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.quobyte_client_cfg = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.quobyte_volume_url = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.replication_device = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.report_discard_supported = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.reserved_percentage = 0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.scst_target_driver = iscsi {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.scst_target_iqn_name = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.storage_protocol = iSCSI {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.target_helper = tgtadm {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.target_ip_address = 192.168.122.132 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.target_port   = 3260 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.target_protocol = iscsi {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.trace_flags   = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.unique_fqdn_network = True {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.use_chap_auth = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.volume_backend_name = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.volume_clear  = zero {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.volume_clear_ionice = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.volume_clear_size = 0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_reports.file_event_handler = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_reports.log_dir           = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.backend_availability_zone = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.backend_host         = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.chap_password        = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.chap_username        = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.chiscsi_conf         = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.disk_geometry        = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.driver_client_cert   = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.driver_client_cert_key = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.driver_data_namespace = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.driver_use_ssl       = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.extra_capabilities   = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.filter_function      = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.goodness_function    = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.iscsi_target_flags   = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.iscsi_write_cache    = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.iser_helper          = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.iser_ip_address      = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.iser_port            = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.iser_target_prefix   = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.nas_host             = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.nas_login            = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.nas_mount_options    = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.nas_password         = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.nas_private_key      = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.nas_share_path       = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.nas_ssh_port         = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.num_shell_tries      = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.nvmet_ns_id          = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.nvmet_port_id        = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.replication_device   = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.report_discard_supported = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.reserved_percentage  = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.scst_target_driver   = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.storage_protocol     = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.target_helper        = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.target_ip_address    = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.target_port          = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.target_prefix        = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.target_protocol      = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.trace_flags          = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.unique_fqdn_network  = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.use_chap_auth        = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.volume_clear         = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.volume_clear_ionice  = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.volume_clear_size    = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] QuobyteHD.volumes_dir          = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.ssl      = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.ssl_version =  {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_notifications.driver = [] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_notifications.retry = -1 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] oslo_messaging_notifications.transport_url = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] key_manager.fixed_key          = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican.barbican_api_version  = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican.barbican_endpoint     = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican.barbican_endpoint_type = public {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican.barbican_region_name  = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican.cafile                = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican.certfile              = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican.collect_timing        = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican.insecure              = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican.keyfile               = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican.number_of_retries     = 60 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican.retry_delay           = 1 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican.send_service_user_token = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican.split_loggers         = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican.timeout               = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican.verify_ssl            = True {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican.verify_ssl_path       = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican_service_user.auth_section = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican_service_user.auth_type = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican_service_user.cafile   = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican_service_user.certfile = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican_service_user.collect_timing = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican_service_user.insecure = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican_service_user.keyfile  = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican_service_user.split_loggers = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] barbican_service_user.timeout  = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] vault.approle_role_id          = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] vault.approle_secret_id        = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] vault.kv_mountpoint            = secret {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] vault.kv_path                  = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] vault.kv_version               = 2 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] vault.namespace                = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] vault.root_token_id            = **** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] vault.ssl_ca_crt_file          = None {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] vault.timeout                  = 60.0 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] vault.use_ssl                  = False {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 26 05:40:52 devstack cinder-volume[93409]: DEBUG oslo_service.backend._eventlet.service [None req-bf9253a6-8970-49a3-b4e6-8d9c2ade80fd None None] ******************************************************************************** {{(pid=93409) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jun 26 05:40:53 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root
Jun 26 05:40:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.609s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:40:53 devstack cinder-volume[93708]: INFO cinder.volume.driver [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Driver hasn't implemented _init_vendor_properties()
Jun 26 05:40:53 devstack cinder-volume[93708]: DEBUG cinder.volume.driver [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93708) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 26 05:40:53 devstack cinder-volume[93708]: DEBUG oslo_db.sqlalchemy.engines [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93708) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 26 05:40:53 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writer thread running {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 26 05:40:53 devstack cinder-volume[93708]: DEBUG cinder.db.api [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Building query based on filter {{(pid=93708) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jun 26 05:40:53 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93708) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 26 05:40:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:40:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:40:53 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:40:53 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:40:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:40:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:40:53 devstack cinder-volume[93708]: INFO cinder.keymgr.migration [None req-9a47eb63-2033-4b80-8358-b6490bbf88e4 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 26 05:40:53 devstack sudo[93734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:40:53 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:40:53 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root
Jun 26 05:40:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.601s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:40:53 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:40:53 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Driver initialization completed successfully.
Jun 26 05:40:53 devstack cinder-volume[93708]: INFO cinder.manager [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Initiating service 3 cleanup
Jun 26 05:40:53 devstack cinder-volume[93708]: INFO cinder.manager [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Service 3 cleanup completed.
Jun 26 05:40:53 devstack cinder-volume[93708]: DEBUG cinder.service [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Creating RPC server for service cinder-volume {{(pid=93708) start /opt/stack/cinder/cinder/service.py:231}}
Jun 26 05:40:53 devstack cinder-volume[93708]: DEBUG cinder.service [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93708) start /opt/stack/cinder/cinder/service.py:237}}
Jun 26 05:40:54 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 26 05:40:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:40:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:40:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:40:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:40:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:40:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:40:54 devstack sudo[93781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:40:54 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:40:54 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root
Jun 26 05:40:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.609s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:40:54 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-99b9b46f-3f04-43ab-9859-352f9656df28 None None] Driver post RPC initialization completed successfully.
Jun 26 05:41:02 devstack cinder-volume[93409]: DEBUG dbcounter [-] [93409] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93409) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:41:03 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:41:04 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=3 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:41:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:41:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 6 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:41:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:41:52 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-a288b3f4-1f62-449a-83ff-a4155df655f1 tempest-GroupsTest-346442096 None] Group tempest-Group1-1096677203: creating
Jun 26 05:41:52 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-a288b3f4-1f62-449a-83ff-a4155df655f1 tempest-GroupsTest-346442096 None] Group tempest-Group1-1096677203: created successfully
Jun 26 05:41:52 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-a288b3f4-1f62-449a-83ff-a4155df655f1 tempest-GroupsTest-346442096 None] Create group completed successfully.
Jun 26 05:41:53 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-dc4f722f-b236-4d38-ad35-e3bcb3ff81bb tempest-GroupsTest-346442096 None] Group tempest-Group2-93079600: creating
Jun 26 05:41:53 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-dc4f722f-b236-4d38-ad35-e3bcb3ff81bb tempest-GroupsTest-346442096 None] Group tempest-Group2-93079600: created successfully
Jun 26 05:41:53 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-dc4f722f-b236-4d38-ad35-e3bcb3ff81bb tempest-GroupsTest-346442096 None] Create group completed successfully.
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Flow 'volume_create_manager' (f5c785c6-60eb-4751-b8ba-24c2b0d084fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5988efeb-b5ca-439a-9a7c-1d6efd6826da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5988efeb-b5ca-439a-9a7c-1d6efd6826da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-354113969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2ef15976-e7ce-46fe-8fe1-c6e0e8545ab8,host='devstack@QuobyteHD#QuobyteHD',id=e7204e10-05fb-4337-941c-72805f8e6a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c9e0609abf4c6baa265c426a70acb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:41:55Z,use_quota=True,user_id='300f258009b548adb0471262232000df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e43b90b-39dd-4a10-a30f-1da830743714),volume_type_id=5e43b90b-39dd-4a10-a30f-1da830743714)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05f8371-e94b-48c5-8406-ab5a93061252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05f8371-e94b-48c5-8406-ab5a93061252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053e5d1b-86fc-41aa-b29f-e1324cdd19bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053e5d1b-86fc-41aa-b29f-e1324cdd19bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7204e10-05fb-4337-941c-72805f8e6a0b', 'volume_name': 'volume-e7204e10-05fb-4337-941c-72805f8e6a0b', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71bb303d-1dc3-4d72-983f-6058ec409cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71bb303d-1dc3-4d72-983f-6058ec409cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57703316-22bd-4901-9e3e-aebaef169747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:41:55 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Volume e7204e10-05fb-4337-941c-72805f8e6a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7204e10-05fb-4337-941c-72805f8e6a0b', 'volume_size': 1}
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2ef15976-e7ce-46fe-8fe1-c6e0e8545ab8,created_at=2026-06-26T03:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-354113969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2ef15976-e7ce-46fe-8fe1-c6e0e8545ab8,host='devstack@QuobyteHD#QuobyteHD',id=e7204e10-05fb-4337-941c-72805f8e6a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c9e0609abf4c6baa265c426a70acb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:41:55Z,use_quota=True,user_id='300f258009b548adb0471262232000df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e43b90b-39dd-4a10-a30f-1da830743714),volume_type_id=5e43b90b-39dd-4a10-a30f-1da830743714)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Creating volume e7204e10-05fb-4337-941c-72805f8e6a0b {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:41:55 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:41:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e7204e10-05fb-4337-941c-72805f8e6a0b 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:41:55 devstack sudo[94416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e7204e10-05fb-4337-941c-72805f8e6a0b 1073741824
Jun 26 05:41:55 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:41:57 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root
Jun 26 05:41:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e7204e10-05fb-4337-941c-72805f8e6a0b 1073741824" returned: 0 in 2.268s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:41:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e7204e10-05fb-4337-941c-72805f8e6a0b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:41:58 devstack sudo[94755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e7204e10-05fb-4337-941c-72805f8e6a0b
Jun 26 05:41:58 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:41:59 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root
Jun 26 05:41:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e7204e10-05fb-4337-941c-72805f8e6a0b" returned: 0 in 1.512s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:41:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] <== create_volume: return (3879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:41:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.882s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:41:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57703316-22bd-4901-9e3e-aebaef169747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7204e10-05fb-4337-941c-72805f8e6a0b', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:41:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9895673e-1c6d-4aaa-9355-18ca599186c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:41:59 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Volume volume-e7204e10-05fb-4337-941c-72805f8e6a0b (e7204e10-05fb-4337-941c-72805f8e6a0b): created successfully
Jun 26 05:41:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9895673e-1c6d-4aaa-9355-18ca599186c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:41:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Flow 'volume_create_manager' (f5c785c6-60eb-4751-b8ba-24c2b0d084fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:41:59 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-4d062a90-9fbe-43be-9a04-137e58f5be7a tempest-GroupsTest-346442096 None] Created volume successfully.
Jun 26 05:42:01 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] Acquiring lock "cinder-quobyte-e7204e10-05fb-4337-941c-72805f8e6a0b" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:42:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] Lock "cinder-quobyte-e7204e10-05fb-4337-941c-72805f8e6a0b" acquired by "delete_volume" :: waited 0.020s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:42:02 devstack cinder-volume[93708]: INFO oslo.privsep.daemon [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpp9mhz6o7/privsep.sock']
Jun 26 05:42:02 devstack sudo[94834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpp9mhz6o7/privsep.sock
Jun 26 05:42:02 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:02 devstack cinder-volume[93708]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jun 26 05:42:02 devstack cinder-volume[93708]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 26 05:42:02 devstack cinder-volume[93708]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 26 05:42:02 devstack cinder-volume[93708]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 26 05:42:02 devstack cinder-volume[93708]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 26 05:42:02 devstack cinder-volume[93708]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 26 05:42:02 devstack cinder-volume[93708]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 26 05:42:02 devstack cinder-volume[93708]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 26 05:42:02 devstack cinder-volume[93708]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jun 26 05:42:03 devstack cinder-volume[93708]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jun 26 05:42:03 devstack cinder-volume[93708]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 26 05:42:03 devstack cinder-volume[93708]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 26 05:42:03 devstack cinder-volume[93708]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 26 05:42:03 devstack cinder-volume[93708]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 26 05:42:03 devstack cinder-volume[93708]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 26 05:42:03 devstack cinder-volume[93708]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 26 05:42:03 devstack cinder-volume[93708]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 26 05:42:03 devstack cinder-volume[93708]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jun 26 05:42:03 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:03 devstack cinder-volume[93708]: INFO oslo.privsep.daemon [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] Spawned new privsep daemon via rootwrap
Jun 26 05:42:03 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] Accepted privsep connection to /tmp/tmpp9mhz6o7/privsep.sock {{(pid=93708) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jun 26 05:42:03 devstack cinder-volume[93708]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jun 26 05:42:03 devstack cinder-volume[93708]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jun 26 05:42:03 devstack cinder-volume[93708]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jun 26 05:42:03 devstack cinder-volume[93708]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94841
Jun 26 05:42:03 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c29912b-20e4-4bea-b37a-57e939095992]: (2,) {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:42:03 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5b34a6-9f82-42cd-acfa-ce77baddb302]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:42:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e7204e10-05fb-4337-941c-72805f8e6a0b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:03 devstack sudo[94843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e7204e10-05fb-4337-941c-72805f8e6a0b
Jun 26 05:42:03 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:04 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e7204e10-05fb-4337-941c-72805f8e6a0b" returned: 0 in 0.870s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e7204e10-05fb-4337-941c-72805f8e6a0b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:04 devstack sudo[94850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e7204e10-05fb-4337-941c-72805f8e6a0b
Jun 26 05:42:04 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:05 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e7204e10-05fb-4337-941c-72805f8e6a0b" returned: 0 in 0.728s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:05 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] Lock "cinder-quobyte-e7204e10-05fb-4337-941c-72805f8e6a0b" released by "delete_volume" :: held 3.296s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:42:05 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] Created reservations ['1f5b7318-85d3-494b-ad7f-3d3a8b5e2e03'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:42:05 devstack cinder-volume[93708]: WARNING cinder.quota [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1287444963 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1287444963, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:42:05 devstack cinder-volume[93708]: WARNING cinder.quota [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1287444963 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1287444963, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:42:05 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] Created reservations ['ac466f4d-309b-42ec-b137-131bde91d62b', '430965a5-49c7-447d-85d3-8ed5ddaab963', 'c6c2650d-e701-4dba-9813-21c5ee0f8728', 'defd4c4a-e1b4-4d68-9cbd-ac11d400fe91'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:42:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:42:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:42:05 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:42:05 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:42:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:42:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:05 devstack sudo[94905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:42:05 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:06 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.924s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:06 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:42:06 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-b2819d43-5d47-4d9c-9eaa-864551888934 tempest-GroupsTest-346442096 None] Delete group completed successfully.
Jun 26 05:42:07 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-1184d765-a706-4d25-adb8-a61758cd837b tempest-GroupsTest-346442096 None] Created reservations ['acef95e4-4648-486c-9517-b85aae53a028'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:42:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1184d765-a706-4d25-adb8-a61758cd837b tempest-GroupsTest-346442096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:42:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1184d765-a706-4d25-adb8-a61758cd837b tempest-GroupsTest-346442096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:42:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-1184d765-a706-4d25-adb8-a61758cd837b tempest-GroupsTest-346442096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:42:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-1184d765-a706-4d25-adb8-a61758cd837b tempest-GroupsTest-346442096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:42:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1184d765-a706-4d25-adb8-a61758cd837b tempest-GroupsTest-346442096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:42:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1184d765-a706-4d25-adb8-a61758cd837b tempest-GroupsTest-346442096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:07 devstack sudo[94916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:42:07 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:08 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1184d765-a706-4d25-adb8-a61758cd837b tempest-GroupsTest-346442096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.587s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:08 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-1184d765-a706-4d25-adb8-a61758cd837b tempest-GroupsTest-346442096 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:42:09 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-1184d765-a706-4d25-adb8-a61758cd837b tempest-GroupsTest-346442096 None] Delete group completed successfully.
Jun 26 05:42:09 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e526a25e-eb3d-405c-b6a3-c68bfea0298b tempest-GroupsTest-346442096 None] Group tempest-GroupsTest-Group-93233507: creating
Jun 26 05:42:09 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e526a25e-eb3d-405c-b6a3-c68bfea0298b tempest-GroupsTest-346442096 None] Group tempest-GroupsTest-Group-93233507: created successfully
Jun 26 05:42:09 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e526a25e-eb3d-405c-b6a3-c68bfea0298b tempest-GroupsTest-346442096 None] Create group completed successfully.
Jun 26 05:42:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:42:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:42:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:42:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:42:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:42:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:42:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:10 devstack sudo[94922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:42:10 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:12 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.347s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 8 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Flow 'volume_create_manager' (94323296-f863-4850-b2a4-8c9d34ac4695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a67c52-8d04-4cb6-843a-bcb0e2580b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a67c52-8d04-4cb6-843a-bcb0e2580b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-671561431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=813e2439-8032-4e72-80b1-d867594cad7a,host='devstack@QuobyteHD#QuobyteHD',id=fd7f82d5-9710-4ccb-af76-76d15bfbd379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c9e0609abf4c6baa265c426a70acb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:42:12Z,use_quota=True,user_id='300f258009b548adb0471262232000df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cdddfee-92bc-4af2-8eea-d94622814a92),volume_type_id=5cdddfee-92bc-4af2-8eea-d94622814a92)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5dd1bf-e847-4cba-97d5-3811ce95d3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5dd1bf-e847-4cba-97d5-3811ce95d3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f806599c-5301-47f3-9106-467ed5b2aeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f806599c-5301-47f3-9106-467ed5b2aeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd7f82d5-9710-4ccb-af76-76d15bfbd379', 'volume_name': 'volume-fd7f82d5-9710-4ccb-af76-76d15bfbd379', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11cf1f2c-dfcc-4fc1-9c55-a7c2a821569d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11cf1f2c-dfcc-4fc1-9c55-a7c2a821569d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34832e6-7567-4dfc-9901-348cbcb5a59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:12 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Volume fd7f82d5-9710-4ccb-af76-76d15bfbd379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd7f82d5-9710-4ccb-af76-76d15bfbd379', 'volume_size': 1}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=813e2439-8032-4e72-80b1-d867594cad7a,created_at=2026-06-26T03:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-671561431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=813e2439-8032-4e72-80b1-d867594cad7a,host='devstack@QuobyteHD#QuobyteHD',id=fd7f82d5-9710-4ccb-af76-76d15bfbd379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c9e0609abf4c6baa265c426a70acb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:42:12Z,use_quota=True,user_id='300f258009b548adb0471262232000df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cdddfee-92bc-4af2-8eea-d94622814a92),volume_type_id=5cdddfee-92bc-4af2-8eea-d94622814a92)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Creating volume fd7f82d5-9710-4ccb-af76-76d15bfbd379 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:42:12 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:42:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fd7f82d5-9710-4ccb-af76-76d15bfbd379 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:12 devstack sudo[94972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fd7f82d5-9710-4ccb-af76-76d15bfbd379 1073741824
Jun 26 05:42:12 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:13 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fd7f82d5-9710-4ccb-af76-76d15bfbd379 1073741824" returned: 0 in 1.098s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fd7f82d5-9710-4ccb-af76-76d15bfbd379 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:13 devstack sudo[94995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fd7f82d5-9710-4ccb-af76-76d15bfbd379
Jun 26 05:42:13 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:14 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fd7f82d5-9710-4ccb-af76-76d15bfbd379" returned: 0 in 0.805s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:42:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:42:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34832e6-7567-4dfc-9901-348cbcb5a59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd7f82d5-9710-4ccb-af76-76d15bfbd379', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (610de2a5-02a8-48a8-a1e6-b931b0f2fbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:14 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Volume volume-fd7f82d5-9710-4ccb-af76-76d15bfbd379 (fd7f82d5-9710-4ccb-af76-76d15bfbd379): created successfully
Jun 26 05:42:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (610de2a5-02a8-48a8-a1e6-b931b0f2fbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Flow 'volume_create_manager' (94323296-f863-4850-b2a4-8c9d34ac4695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:42:14 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-18125244-3a0d-487c-9b61-e55f943b584e tempest-GroupsTest-346442096 None] Created volume successfully.
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Flow 'volume_create_manager' (b171f731-630b-4018-ac46-a5209be3ae6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b1d180-d41c-4700-b224-403a66b9efc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b1d180-d41c-4700-b224-403a66b9efc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1440315154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=813e2439-8032-4e72-80b1-d867594cad7a,host='devstack@QuobyteHD#QuobyteHD',id=89870b01-0272-456e-83c6-a51b6157dfec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c9e0609abf4c6baa265c426a70acb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:42:15Z,use_quota=True,user_id='300f258009b548adb0471262232000df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cdddfee-92bc-4af2-8eea-d94622814a92),volume_type_id=5cdddfee-92bc-4af2-8eea-d94622814a92)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd0c6a6-9ba1-4326-aceb-9ba84c365728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd0c6a6-9ba1-4326-aceb-9ba84c365728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d46fd3e-5f4c-4914-a112-ef2616196917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d46fd3e-5f4c-4914-a112-ef2616196917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89870b01-0272-456e-83c6-a51b6157dfec', 'volume_name': 'volume-89870b01-0272-456e-83c6-a51b6157dfec', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (370ccb78-2b47-41d3-a270-9b9574c66775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (370ccb78-2b47-41d3-a270-9b9574c66775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40d0630-b939-4898-8cf3-53ce4d8c42de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:15 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Volume 89870b01-0272-456e-83c6-a51b6157dfec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89870b01-0272-456e-83c6-a51b6157dfec', 'volume_size': 1}
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=813e2439-8032-4e72-80b1-d867594cad7a,created_at=2026-06-26T03:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1440315154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=813e2439-8032-4e72-80b1-d867594cad7a,host='devstack@QuobyteHD#QuobyteHD',id=89870b01-0272-456e-83c6-a51b6157dfec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c9e0609abf4c6baa265c426a70acb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:42:15Z,use_quota=True,user_id='300f258009b548adb0471262232000df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cdddfee-92bc-4af2-8eea-d94622814a92),volume_type_id=5cdddfee-92bc-4af2-8eea-d94622814a92)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Creating volume 89870b01-0272-456e-83c6-a51b6157dfec {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:42:15 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:42:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-89870b01-0272-456e-83c6-a51b6157dfec 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:15 devstack sudo[95038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-89870b01-0272-456e-83c6-a51b6157dfec 1073741824
Jun 26 05:42:15 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:16 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-89870b01-0272-456e-83c6-a51b6157dfec 1073741824" returned: 0 in 0.883s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-89870b01-0272-456e-83c6-a51b6157dfec {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:16 devstack sudo[95044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-89870b01-0272-456e-83c6-a51b6157dfec
Jun 26 05:42:16 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:17 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-89870b01-0272-456e-83c6-a51b6157dfec" returned: 0 in 0.666s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:17 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:42:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:42:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40d0630-b939-4898-8cf3-53ce4d8c42de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89870b01-0272-456e-83c6-a51b6157dfec', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87026668-996d-4eea-9668-28efbd8fe134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:17 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Volume volume-89870b01-0272-456e-83c6-a51b6157dfec (89870b01-0272-456e-83c6-a51b6157dfec): created successfully
Jun 26 05:42:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87026668-996d-4eea-9668-28efbd8fe134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Flow 'volume_create_manager' (b171f731-630b-4018-ac46-a5209be3ae6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:42:17 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-2204059b-bee6-4e99-b8e7-a0fb7705b228 tempest-GroupsTest-346442096 None] Created volume successfully.
Jun 26 05:42:18 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-a74811c6-b767-494a-a799-e2df68c43f65 tempest-GroupsTest-346442096 None] Update group completed successfully.
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Flow 'volume_create_manager' (76ff21b0-dcb2-446c-9d4d-8d85901332f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe0b384-27a8-4005-8b7c-9a07fa7a1791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe0b384-27a8-4005-8b7c-9a07fa7a1791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1312960379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa065f50-0160-433d-921f-64b028e59dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f764b45f734a1285ddaedcebaf896b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:42:19Z,use_quota=True,user_id='1699e136ad17487dbeb15f32e226afce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0b1acb-9bf9-4945-b119-a932b6a4f479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0b1acb-9bf9-4945-b119-a932b6a4f479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d8b5d0-51d3-4549-84b0-f54dff671744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d8b5d0-51d3-4549-84b0-f54dff671744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa065f50-0160-433d-921f-64b028e59dc7', 'volume_name': 'volume-aa065f50-0160-433d-921f-64b028e59dc7', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d833ad8e-6c41-4fd7-a110-c6024b108e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d833ad8e-6c41-4fd7-a110-c6024b108e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743fb7d1-7edf-4adf-9017-9ad2205c4801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:18 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Volume aa065f50-0160-433d-921f-64b028e59dc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa065f50-0160-433d-921f-64b028e59dc7', 'volume_size': 1}
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1312960379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa065f50-0160-433d-921f-64b028e59dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f764b45f734a1285ddaedcebaf896b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:42:19Z,use_quota=True,user_id='1699e136ad17487dbeb15f32e226afce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Creating volume aa065f50-0160-433d-921f-64b028e59dc7 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:42:18 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:42:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aa065f50-0160-433d-921f-64b028e59dc7 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:18 devstack sudo[95047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aa065f50-0160-433d-921f-64b028e59dc7 1073741824
Jun 26 05:42:18 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:19 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aa065f50-0160-433d-921f-64b028e59dc7 1073741824" returned: 0 in 0.966s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aa065f50-0160-433d-921f-64b028e59dc7 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:19 devstack sudo[95052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aa065f50-0160-433d-921f-64b028e59dc7
Jun 26 05:42:19 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:19 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-8b7c47eb-69a1-4b8b-b826-e92ee6182dbf tempest-GroupsTest-346442096 None] Update group completed successfully.
Jun 26 05:42:20 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aa065f50-0160-433d-921f-64b028e59dc7" returned: 0 in 0.681s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:20 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:42:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:42:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743fb7d1-7edf-4adf-9017-9ad2205c4801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa065f50-0160-433d-921f-64b028e59dc7', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33858ee5-bee6-4278-9d2a-4905ef7a2ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:20 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Volume volume-aa065f50-0160-433d-921f-64b028e59dc7 (aa065f50-0160-433d-921f-64b028e59dc7): created successfully
Jun 26 05:42:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33858ee5-bee6-4278-9d2a-4905ef7a2ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Flow 'volume_create_manager' (76ff21b0-dcb2-446c-9d4d-8d85901332f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:42:20 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-90f77a4f-e8e2-43b0-b013-f79244dd7fdc tempest-ServersNegativeTestJSON-494103511 None] Created volume successfully.
Jun 26 05:42:21 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Acquiring lock "cinder-quobyte-89870b01-0272-456e-83c6-a51b6157dfec" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:42:21 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Lock "cinder-quobyte-89870b01-0272-456e-83c6-a51b6157dfec" acquired by "delete_volume" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:42:21 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca818f6-7dea-4d34-b250-7cdb51c558d3]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:42:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-89870b01-0272-456e-83c6-a51b6157dfec {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:21 devstack sudo[95056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-89870b01-0272-456e-83c6-a51b6157dfec
Jun 26 05:42:21 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Flow 'volume_create_manager' (2213cec8-a0b4-4fbd-88e5-98ac4252b42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc4f1fd-2ac9-46de-93e5-9ebd99e6bed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc4f1fd-2ac9-46de-93e5-9ebd99e6bed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1345641175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1329fa90-faa4-4875-89d6-fe6a6fd630d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f764b45f734a1285ddaedcebaf896b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:42:22Z,use_quota=True,user_id='1699e136ad17487dbeb15f32e226afce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45531a3-f391-4871-82ac-444522d178a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45531a3-f391-4871-82ac-444522d178a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b708849d-765b-455a-ba96-f441b66eac8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b708849d-765b-455a-ba96-f441b66eac8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1329fa90-faa4-4875-89d6-fe6a6fd630d0', 'volume_name': 'volume-1329fa90-faa4-4875-89d6-fe6a6fd630d0', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ed023a-d74d-426d-934f-e1d4b371adb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ed023a-d74d-426d-934f-e1d4b371adb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7deebf35-294c-430a-bc18-affe98c89b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:22 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Volume 1329fa90-faa4-4875-89d6-fe6a6fd630d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1329fa90-faa4-4875-89d6-fe6a6fd630d0', 'volume_size': 1}
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1345641175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1329fa90-faa4-4875-89d6-fe6a6fd630d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f764b45f734a1285ddaedcebaf896b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:42:22Z,use_quota=True,user_id='1699e136ad17487dbeb15f32e226afce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Creating volume 1329fa90-faa4-4875-89d6-fe6a6fd630d0 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:42:22 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1329fa90-faa4-4875-89d6-fe6a6fd630d0 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:22 devstack sudo[95058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1329fa90-faa4-4875-89d6-fe6a6fd630d0 1073741824
Jun 26 05:42:22 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:22 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-89870b01-0272-456e-83c6-a51b6157dfec" returned: 0 in 0.795s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-89870b01-0272-456e-83c6-a51b6157dfec {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:22 devstack sudo[95064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-89870b01-0272-456e-83c6-a51b6157dfec
Jun 26 05:42:22 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:23 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1329fa90-faa4-4875-89d6-fe6a6fd630d0 1073741824" returned: 0 in 1.153s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1329fa90-faa4-4875-89d6-fe6a6fd630d0 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:23 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-89870b01-0272-456e-83c6-a51b6157dfec" returned: 0 in 1.009s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:23 devstack sudo[95073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1329fa90-faa4-4875-89d6-fe6a6fd630d0
Jun 26 05:42:23 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:23 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Lock "cinder-quobyte-89870b01-0272-456e-83c6-a51b6157dfec" released by "delete_volume" :: held 1.870s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:42:23 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Acquiring lock "cinder-quobyte-fd7f82d5-9710-4ccb-af76-76d15bfbd379" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:42:23 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Lock "cinder-quobyte-fd7f82d5-9710-4ccb-af76-76d15bfbd379" acquired by "delete_volume" :: waited 0.028s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:42:23 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[8496d655-def6-42ed-adef-3721e85d7a40]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:42:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fd7f82d5-9710-4ccb-af76-76d15bfbd379 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:23 devstack sudo[95075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fd7f82d5-9710-4ccb-af76-76d15bfbd379
Jun 26 05:42:23 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Flow 'volume_create_manager' (c0267954-c0a8-4978-abbe-6b1a6e21b8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765e073b-816c-49a9-94b1-f3fa63971fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765e073b-816c-49a9-94b1-f3fa63971fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-890594708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ec2b25-b2b9-4e93-8640-da6104b7a633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7ca276d740b44a5a1b9b5e94080fb9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:42:24Z,use_quota=True,user_id='7cbbaeba67a648be8dcd3dd515449be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40e5c57-39dc-4882-9428-afef3bd10776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40e5c57-39dc-4882-9428-afef3bd10776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd96329-f357-419a-87ce-be2289236732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd96329-f357-419a-87ce-be2289236732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ec2b25-b2b9-4e93-8640-da6104b7a633', 'volume_name': 'volume-63ec2b25-b2b9-4e93-8640-da6104b7a633', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b7800f-03f7-4299-98e2-6d51b2f6b819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:24 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b7800f-03f7-4299-98e2-6d51b2f6b819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635fe096-2006-4da6-ae3a-5acb8c373bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:24 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Volume 63ec2b25-b2b9-4e93-8640-da6104b7a633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ec2b25-b2b9-4e93-8640-da6104b7a633', 'volume_size': 1}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1329fa90-faa4-4875-89d6-fe6a6fd630d0" returned: 0 in 0.994s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] <== create_volume: return (2205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.208s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-890594708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ec2b25-b2b9-4e93-8640-da6104b7a633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7ca276d740b44a5a1b9b5e94080fb9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:42:24Z,use_quota=True,user_id='7cbbaeba67a648be8dcd3dd515449be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Creating volume 63ec2b25-b2b9-4e93-8640-da6104b7a633 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:42:24 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63ec2b25-b2b9-4e93-8640-da6104b7a633 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7deebf35-294c-430a-bc18-affe98c89b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1329fa90-faa4-4875-89d6-fe6a6fd630d0', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:24 devstack sudo[95078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63ec2b25-b2b9-4e93-8640-da6104b7a633 1073741824
Jun 26 05:42:24 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1788f2-6193-46c7-87d0-dd737882e889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:24 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Volume volume-1329fa90-faa4-4875-89d6-fe6a6fd630d0 (1329fa90-faa4-4875-89d6-fe6a6fd630d0): created successfully
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1788f2-6193-46c7-87d0-dd737882e889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Flow 'volume_create_manager' (2213cec8-a0b4-4fbd-88e5-98ac4252b42c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:42:24 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-14bd42e6-b6d3-4177-b58f-99f7bb910000 tempest-ServersNegativeTestJSON-494103511 None] Created volume successfully.
Jun 26 05:42:24 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fd7f82d5-9710-4ccb-af76-76d15bfbd379" returned: 0 in 1.349s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fd7f82d5-9710-4ccb-af76-76d15bfbd379 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:24 devstack sudo[95083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fd7f82d5-9710-4ccb-af76-76d15bfbd379
Jun 26 05:42:24 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:25 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63ec2b25-b2b9-4e93-8640-da6104b7a633 1073741824" returned: 0 in 1.189s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63ec2b25-b2b9-4e93-8640-da6104b7a633 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:25 devstack sudo[95089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63ec2b25-b2b9-4e93-8640-da6104b7a633
Jun 26 05:42:25 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:25 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fd7f82d5-9710-4ccb-af76-76d15bfbd379" returned: 0 in 1.003s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:25 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Lock "cinder-quobyte-fd7f82d5-9710-4ccb-af76-76d15bfbd379" released by "delete_volume" :: held 2.404s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:42:25 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Created reservations ['eed9c487-40e4-401f-8193-cde9e561e55d'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:42:26 devstack cinder-volume[93708]: WARNING cinder.quota [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-305749495 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-305749495, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:42:26 devstack cinder-volume[93708]: WARNING cinder.quota [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-305749495 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-305749495, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:42:26 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Created reservations ['30939918-c4b3-4f4c-80a5-73c457a822b5', '8f5a0ed8-5eeb-465b-aed9-052e40a43cd0', '752c68ef-b678-4896-9dd4-e7f00e2a1954', '2ea387bf-64c7-42f7-a2f5-d46b91e0994c'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:42:26 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Created reservations ['e42ca829-0d6c-402a-a680-e0afd689e7c5', 'aa93a11d-3bd6-43d5-8638-3764f452f486', '3d19f3f5-5f95-4e5c-9b72-6d0923e71cad', '781c1905-5e04-489b-9d54-38418107c38e'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:42:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:42:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:42:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:42:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:42:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:42:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:26 devstack sudo[95093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:42:26 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:26 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63ec2b25-b2b9-4e93-8640-da6104b7a633" returned: 0 in 0.845s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] <== create_volume: return (2102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:42:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.106s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:42:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635fe096-2006-4da6-ae3a-5acb8c373bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ec2b25-b2b9-4e93-8640-da6104b7a633', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e0fb36-2beb-4bbd-aa84-cb31e50dd465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:26 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Volume volume-63ec2b25-b2b9-4e93-8640-da6104b7a633 (63ec2b25-b2b9-4e93-8640-da6104b7a633): created successfully
Jun 26 05:42:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e0fb36-2beb-4bbd-aa84-cb31e50dd465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Flow 'volume_create_manager' (c0267954-c0a8-4978-abbe-6b1a6e21b8f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:42:26 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-439b56be-4854-4f5d-b3b8-2db91f0448e4 tempest-ServerActionsTestOtherA-2094131569 None] Created volume successfully.
Jun 26 05:42:26 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.730s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:27 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:42:27 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-565f76a7-362e-4314-ac99-3ee02a016b44 tempest-GroupsTest-346442096 None] Delete group completed successfully.
Jun 26 05:42:29 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] Acquiring lock "cinder-1329fa90-faa4-4875-89d6-fe6a6fd630d0-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:42:29 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] Lock "cinder-1329fa90-faa4-4875-89d6-fe6a6fd630d0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:42:29 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] Acquiring lock "cinder-quobyte-1329fa90-faa4-4875-89d6-fe6a6fd630d0" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:42:29 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] Lock "cinder-quobyte-1329fa90-faa4-4875-89d6-fe6a6fd630d0" acquired by "delete_volume" :: waited 0.027s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:42:29 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a9d7e0-16bd-4372-a001-311a73e4dffd]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:42:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1329fa90-faa4-4875-89d6-fe6a6fd630d0 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:29 devstack sudo[95098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1329fa90-faa4-4875-89d6-fe6a6fd630d0
Jun 26 05:42:29 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:30 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1329fa90-faa4-4875-89d6-fe6a6fd630d0" returned: 0 in 0.917s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1329fa90-faa4-4875-89d6-fe6a6fd630d0 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:30 devstack sudo[95104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1329fa90-faa4-4875-89d6-fe6a6fd630d0
Jun 26 05:42:30 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:31 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1329fa90-faa4-4875-89d6-fe6a6fd630d0" returned: 0 in 0.867s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] Lock "cinder-quobyte-1329fa90-faa4-4875-89d6-fe6a6fd630d0" released by "delete_volume" :: held 1.845s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:42:31 devstack cinder-volume[93708]: WARNING cinder.quota [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:42:31 devstack cinder-volume[93708]: WARNING cinder.quota [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:42:31 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] Created reservations ['a889037e-b916-46cc-94df-bd2bd38638ff', '227ef790-d15f-49b4-a2ef-4ed7d1559f8d', 'fe277eaf-9cee-42c9-b594-3dcecdba2b8b', '4d86ce1c-eb99-476a-960c-81f57f5a54f3'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:42:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:42:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:42:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:42:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:42:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:42:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:31 devstack sudo[95108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:42:31 devstack sudo[95108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2fb5499f-8e86-4de7-b088-b301c489e2e3 tempest-ServersNegativeTestJSON-494103511 None] Acquiring lock "cinder-aa065f50-0160-433d-921f-64b028e59dc7-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:42:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2fb5499f-8e86-4de7-b088-b301c489e2e3 tempest-ServersNegativeTestJSON-494103511 None] Lock "cinder-aa065f50-0160-433d-921f-64b028e59dc7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:42:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2fb5499f-8e86-4de7-b088-b301c489e2e3 tempest-ServersNegativeTestJSON-494103511 None] Acquiring lock "cinder-quobyte-aa065f50-0160-433d-921f-64b028e59dc7" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:42:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2fb5499f-8e86-4de7-b088-b301c489e2e3 tempest-ServersNegativeTestJSON-494103511 None] Lock "cinder-quobyte-aa065f50-0160-433d-921f-64b028e59dc7" acquired by "delete_volume" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:42:31 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[416c105a-3627-4f78-88e6-fd56a7346899]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:42:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2fb5499f-8e86-4de7-b088-b301c489e2e3 tempest-ServersNegativeTestJSON-494103511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aa065f50-0160-433d-921f-64b028e59dc7 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:31 devstack sudo[95110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aa065f50-0160-433d-921f-64b028e59dc7
Jun 26 05:42:31 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:32 devstack sudo[95108]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.991s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:32 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:42:32 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] Deleted volume successfully.
Jun 26 05:42:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e8be1779-fa0e-44b4-8b99-d514329cc063 tempest-ServersNegativeTestJSON-494103511 None] Lock "cinder-1329fa90-faa4-4875-89d6-fe6a6fd630d0-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:42:32 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2fb5499f-8e86-4de7-b088-b301c489e2e3 tempest-ServersNegativeTestJSON-494103511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aa065f50-0160-433d-921f-64b028e59dc7" returned: 0 in 1.165s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2fb5499f-8e86-4de7-b088-b301c489e2e3 tempest-ServersNegativeTestJSON-494103511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aa065f50-0160-433d-921f-64b028e59dc7 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:32 devstack sudo[95121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aa065f50-0160-433d-921f-64b028e59dc7
Jun 26 05:42:32 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:33 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2fb5499f-8e86-4de7-b088-b301c489e2e3 tempest-ServersNegativeTestJSON-494103511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aa065f50-0160-433d-921f-64b028e59dc7" returned: 0 in 1.084s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:33 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2fb5499f-8e86-4de7-b088-b301c489e2e3 tempest-ServersNegativeTestJSON-494103511 None] Lock "cinder-quobyte-aa065f50-0160-433d-921f-64b028e59dc7" released by "delete_volume" :: held 2.325s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:42:33 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-2fb5499f-8e86-4de7-b088-b301c489e2e3 tempest-ServersNegativeTestJSON-494103511 None] Created reservations ['6c3a1ed2-8997-414f-8ae2-8b187354e31c', '9aba9faa-5ff8-4afd-985a-1a91620344c2', '4012ef96-ad6a-41ca-9a4b-742eee486a00', 'b6b42aeb-ed5d-4dd1-90e2-d894dd6b83a0'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:42:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2fb5499f-8e86-4de7-b088-b301c489e2e3 tempest-ServersNegativeTestJSON-494103511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:42:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2fb5499f-8e86-4de7-b088-b301c489e2e3 tempest-ServersNegativeTestJSON-494103511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:42:34 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2fb5499f-8e86-4de7-b088-b301c489e2e3 tempest-ServersNegativeTestJSON-494103511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:42:34 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2fb5499f-8e86-4de7-b088-b301c489e2e3 tempest-ServersNegativeTestJSON-494103511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:42:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2fb5499f-8e86-4de7-b088-b301c489e2e3 tempest-ServersNegativeTestJSON-494103511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:42:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2fb5499f-8e86-4de7-b088-b301c489e2e3 tempest-ServersNegativeTestJSON-494103511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:34 devstack sudo[95126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:42:34 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:35 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2fb5499f-8e86-4de7-b088-b301c489e2e3 tempest-ServersNegativeTestJSON-494103511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.961s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:35 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-2fb5499f-8e86-4de7-b088-b301c489e2e3 tempest-ServersNegativeTestJSON-494103511 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:42:35 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-2fb5499f-8e86-4de7-b088-b301c489e2e3 tempest-ServersNegativeTestJSON-494103511 None] Deleted volume successfully.
Jun 26 05:42:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2fb5499f-8e86-4de7-b088-b301c489e2e3 tempest-ServersNegativeTestJSON-494103511 None] Lock "cinder-aa065f50-0160-433d-921f-64b028e59dc7-delete_volume" released by "delete_volume" :: held 3.630s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:42:44 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=59,cinder:UPDATE=74,cinder:INSERT=14,cinder:DELETE=2 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:42:45 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=55,cinder:UPDATE=67,cinder:INSERT=15,cinder:DELETE=6 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:42:57 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:42:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Flow 'volume_create_manager' (5e00f7ee-d315-4deb-aedc-a662645ecc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:42:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9423fac3-f378-4809-8626-372f7357c4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9423fac3-f378-4809-8626-372f7357c4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1919075429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807644fa-9e38-4da7-90c4-c7b779ebd2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5686cf808300498bb38c05123f113c2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:42:58Z,use_quota=True,user_id='76d510f4428f43e9a6f7e6c2f5854f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719116c6-1f8e-4aa2-9c91-20626ae5f366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719116c6-1f8e-4aa2-9c91-20626ae5f366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58faa0b2-004d-47cb-97aa-67e0c778d41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58faa0b2-004d-47cb-97aa-67e0c778d41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '807644fa-9e38-4da7-90c4-c7b779ebd2ed', 'volume_name': 'volume-807644fa-9e38-4da7-90c4-c7b779ebd2ed', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28243637-97d9-4c90-990e-5ed99d408362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28243637-97d9-4c90-990e-5ed99d408362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:42:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f8d05d-a204-4d23-aa25-32ceb6770b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:42:58 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Volume 807644fa-9e38-4da7-90c4-c7b779ebd2ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-807644fa-9e38-4da7-90c4-c7b779ebd2ed', 'volume_size': 1}
Jun 26 05:42:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:42:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:42:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1919075429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807644fa-9e38-4da7-90c4-c7b779ebd2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5686cf808300498bb38c05123f113c2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:42:58Z,use_quota=True,user_id='76d510f4428f43e9a6f7e6c2f5854f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:42:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Creating volume 807644fa-9e38-4da7-90c4-c7b779ebd2ed {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:42:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:42:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:42:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:42:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:42:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:42:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:42:58 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:42:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-807644fa-9e38-4da7-90c4-c7b779ebd2ed 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:58 devstack sudo[95277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-807644fa-9e38-4da7-90c4-c7b779ebd2ed 1073741824
Jun 26 05:42:58 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:42:59 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root
Jun 26 05:42:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-807644fa-9e38-4da7-90c4-c7b779ebd2ed 1073741824" returned: 0 in 1.469s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:42:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-807644fa-9e38-4da7-90c4-c7b779ebd2ed {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:42:59 devstack sudo[95289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-807644fa-9e38-4da7-90c4-c7b779ebd2ed
Jun 26 05:42:59 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:00 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-807644fa-9e38-4da7-90c4-c7b779ebd2ed" returned: 0 in 0.773s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:00 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] <== create_volume: return (2325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:43:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.330s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:43:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f8d05d-a204-4d23-aa25-32ceb6770b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-807644fa-9e38-4da7-90c4-c7b779ebd2ed', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f35f6e3-7457-4c5d-a015-0015f21417b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:00 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Volume volume-807644fa-9e38-4da7-90c4-c7b779ebd2ed (807644fa-9e38-4da7-90c4-c7b779ebd2ed): created successfully
Jun 26 05:43:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f35f6e3-7457-4c5d-a015-0015f21417b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Flow 'volume_create_manager' (5e00f7ee-d315-4deb-aedc-a662645ecc79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:43:00 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-928041aa-16a1-46fc-b525-a779282e786f tempest-VolumeQuotasAdminTestJSON-2073686443 None] Created volume successfully.
Jun 26 05:43:01 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a2251156-e8ff-4ac2-aea1-04afc51d35d4 tempest-VolumeQuotasAdminTestJSON-2073686443 None] Acquiring lock "cinder-807644fa-9e38-4da7-90c4-c7b779ebd2ed-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:43:01 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a2251156-e8ff-4ac2-aea1-04afc51d35d4 tempest-VolumeQuotasAdminTestJSON-2073686443 None] Lock "cinder-807644fa-9e38-4da7-90c4-c7b779ebd2ed-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:43:01 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a2251156-e8ff-4ac2-aea1-04afc51d35d4 tempest-VolumeQuotasAdminTestJSON-2073686443 None] Acquiring lock "cinder-quobyte-807644fa-9e38-4da7-90c4-c7b779ebd2ed" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:43:01 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a2251156-e8ff-4ac2-aea1-04afc51d35d4 tempest-VolumeQuotasAdminTestJSON-2073686443 None] Lock "cinder-quobyte-807644fa-9e38-4da7-90c4-c7b779ebd2ed" acquired by "delete_volume" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:43:01 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee85e56-9555-4187-af0d-1c054351b76a]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:43:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a2251156-e8ff-4ac2-aea1-04afc51d35d4 tempest-VolumeQuotasAdminTestJSON-2073686443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-807644fa-9e38-4da7-90c4-c7b779ebd2ed {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:01 devstack sudo[95295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-807644fa-9e38-4da7-90c4-c7b779ebd2ed
Jun 26 05:43:01 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:02 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a2251156-e8ff-4ac2-aea1-04afc51d35d4 tempest-VolumeQuotasAdminTestJSON-2073686443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-807644fa-9e38-4da7-90c4-c7b779ebd2ed" returned: 0 in 1.154s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a2251156-e8ff-4ac2-aea1-04afc51d35d4 tempest-VolumeQuotasAdminTestJSON-2073686443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-807644fa-9e38-4da7-90c4-c7b779ebd2ed {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:02 devstack sudo[95315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-807644fa-9e38-4da7-90c4-c7b779ebd2ed
Jun 26 05:43:02 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:04 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a2251156-e8ff-4ac2-aea1-04afc51d35d4 tempest-VolumeQuotasAdminTestJSON-2073686443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-807644fa-9e38-4da7-90c4-c7b779ebd2ed" returned: 0 in 1.376s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:04 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a2251156-e8ff-4ac2-aea1-04afc51d35d4 tempest-VolumeQuotasAdminTestJSON-2073686443 None] Lock "cinder-quobyte-807644fa-9e38-4da7-90c4-c7b779ebd2ed" released by "delete_volume" :: held 2.644s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:43:04 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-a2251156-e8ff-4ac2-aea1-04afc51d35d4 tempest-VolumeQuotasAdminTestJSON-2073686443 None] Created reservations ['b177cd8d-b80d-4a6e-a6b0-ea4c69a77079', 'f4ff5504-e4c5-4666-938b-8017eafa8be3', '4f734027-b135-4fbf-847a-2934123ec9cf', 'eaade7e3-19b3-4b7e-ad14-a70309bdb53e'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:43:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a2251156-e8ff-4ac2-aea1-04afc51d35d4 tempest-VolumeQuotasAdminTestJSON-2073686443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:43:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a2251156-e8ff-4ac2-aea1-04afc51d35d4 tempest-VolumeQuotasAdminTestJSON-2073686443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:43:04 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a2251156-e8ff-4ac2-aea1-04afc51d35d4 tempest-VolumeQuotasAdminTestJSON-2073686443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:43:04 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a2251156-e8ff-4ac2-aea1-04afc51d35d4 tempest-VolumeQuotasAdminTestJSON-2073686443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:43:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a2251156-e8ff-4ac2-aea1-04afc51d35d4 tempest-VolumeQuotasAdminTestJSON-2073686443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:43:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a2251156-e8ff-4ac2-aea1-04afc51d35d4 tempest-VolumeQuotasAdminTestJSON-2073686443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:04 devstack sudo[95327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:43:04 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:05 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a2251156-e8ff-4ac2-aea1-04afc51d35d4 tempest-VolumeQuotasAdminTestJSON-2073686443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.204s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:05 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-a2251156-e8ff-4ac2-aea1-04afc51d35d4 tempest-VolumeQuotasAdminTestJSON-2073686443 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:43:05 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-a2251156-e8ff-4ac2-aea1-04afc51d35d4 tempest-VolumeQuotasAdminTestJSON-2073686443 None] Deleted volume successfully.
Jun 26 05:43:05 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a2251156-e8ff-4ac2-aea1-04afc51d35d4 tempest-VolumeQuotasAdminTestJSON-2073686443 None] Lock "cinder-807644fa-9e38-4da7-90c4-c7b779ebd2ed-delete_volume" released by "delete_volume" :: held 4.214s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:43:05 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:43:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Flow 'volume_create_manager' (016e93be-ee20-4d43-b29a-7769bbaa9b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:43:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac8c89d-c175-4f87-bbeb-0cf4005da09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac8c89d-c175-4f87-bbeb-0cf4005da09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-179795091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e03ed3-4ac0-4300-b7c7-b260d85283f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5686cf808300498bb38c05123f113c2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:43:06Z,use_quota=True,user_id='76d510f4428f43e9a6f7e6c2f5854f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e4ddd4-9b0e-4eca-b799-f5a27b0ddce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e4ddd4-9b0e-4eca-b799-f5a27b0ddce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:06 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8823d55-4ec9-471f-abb3-631116b6c8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:06 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8823d55-4ec9-471f-abb3-631116b6c8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13e03ed3-4ac0-4300-b7c7-b260d85283f6', 'volume_name': 'volume-13e03ed3-4ac0-4300-b7c7-b260d85283f6', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:06 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a69599-732f-4d57-b616-bca4ed9aff04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:06 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a69599-732f-4d57-b616-bca4ed9aff04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:06 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d1552d-bdd1-4ab5-8796-3b3ca71ddc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:06 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Volume 13e03ed3-4ac0-4300-b7c7-b260d85283f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13e03ed3-4ac0-4300-b7c7-b260d85283f6', 'volume_size': 1}
Jun 26 05:43:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:43:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:43:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-179795091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e03ed3-4ac0-4300-b7c7-b260d85283f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5686cf808300498bb38c05123f113c2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:43:06Z,use_quota=True,user_id='76d510f4428f43e9a6f7e6c2f5854f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:43:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Creating volume 13e03ed3-4ac0-4300-b7c7-b260d85283f6 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:43:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:43:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:43:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:43:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:43:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:43:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:43:06 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:43:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-13e03ed3-4ac0-4300-b7c7-b260d85283f6 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:06 devstack sudo[95332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-13e03ed3-4ac0-4300-b7c7-b260d85283f6 1073741824
Jun 26 05:43:06 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:07 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-13e03ed3-4ac0-4300-b7c7-b260d85283f6 1073741824" returned: 0 in 1.326s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-13e03ed3-4ac0-4300-b7c7-b260d85283f6 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:07 devstack sudo[95338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-13e03ed3-4ac0-4300-b7c7-b260d85283f6
Jun 26 05:43:07 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:08 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-13e03ed3-4ac0-4300-b7c7-b260d85283f6" returned: 0 in 0.808s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:08 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] <== create_volume: return (2197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:43:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.202s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:43:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d1552d-bdd1-4ab5-8796-3b3ca71ddc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13e03ed3-4ac0-4300-b7c7-b260d85283f6', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b52cc8c-5f90-45f4-87d4-ed50de8283ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:08 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Volume volume-13e03ed3-4ac0-4300-b7c7-b260d85283f6 (13e03ed3-4ac0-4300-b7c7-b260d85283f6): created successfully
Jun 26 05:43:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b52cc8c-5f90-45f4-87d4-ed50de8283ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Flow 'volume_create_manager' (016e93be-ee20-4d43-b29a-7769bbaa9b98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:43:08 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-3b444f05-4e49-4162-a70c-d3ca1fd591af tempest-VolumeQuotasAdminTestJSON-2073686443 None] Created volume successfully.
Jun 26 05:43:10 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-783de233-8b6d-433b-84e8-5fe7324c8a5a tempest-VolumeQuotasAdminTestJSON-1194743557 None] Transfer volume completed successfully.
Jun 26 05:43:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:43:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:43:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:43:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:43:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:43:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:43:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:10 devstack sudo[95367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:43:10 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a92afd2e-ef4a-4139-8463-183dfb3aacca tempest-VolumeQuotasAdminTestJSON-1023854658 None] Acquiring lock "cinder-13e03ed3-4ac0-4300-b7c7-b260d85283f6-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:43:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a92afd2e-ef4a-4139-8463-183dfb3aacca tempest-VolumeQuotasAdminTestJSON-1023854658 None] Lock "cinder-13e03ed3-4ac0-4300-b7c7-b260d85283f6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:43:11 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.744s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:11 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:43:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a92afd2e-ef4a-4139-8463-183dfb3aacca tempest-VolumeQuotasAdminTestJSON-1023854658 None] Acquiring lock "cinder-quobyte-13e03ed3-4ac0-4300-b7c7-b260d85283f6" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:43:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a92afd2e-ef4a-4139-8463-183dfb3aacca tempest-VolumeQuotasAdminTestJSON-1023854658 None] Lock "cinder-quobyte-13e03ed3-4ac0-4300-b7c7-b260d85283f6" acquired by "delete_volume" :: waited 0.031s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:43:11 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf75f002-1c80-45c2-a17b-bcc8dbf8ac6d]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:43:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a92afd2e-ef4a-4139-8463-183dfb3aacca tempest-VolumeQuotasAdminTestJSON-1023854658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-13e03ed3-4ac0-4300-b7c7-b260d85283f6 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:11 devstack sudo[95386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-13e03ed3-4ac0-4300-b7c7-b260d85283f6
Jun 26 05:43:11 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:12 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a92afd2e-ef4a-4139-8463-183dfb3aacca tempest-VolumeQuotasAdminTestJSON-1023854658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-13e03ed3-4ac0-4300-b7c7-b260d85283f6" returned: 0 in 1.287s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a92afd2e-ef4a-4139-8463-183dfb3aacca tempest-VolumeQuotasAdminTestJSON-1023854658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-13e03ed3-4ac0-4300-b7c7-b260d85283f6 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:12 devstack sudo[95471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-13e03ed3-4ac0-4300-b7c7-b260d85283f6
Jun 26 05:43:12 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:13 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a92afd2e-ef4a-4139-8463-183dfb3aacca tempest-VolumeQuotasAdminTestJSON-1023854658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-13e03ed3-4ac0-4300-b7c7-b260d85283f6" returned: 0 in 0.837s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:13 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a92afd2e-ef4a-4139-8463-183dfb3aacca tempest-VolumeQuotasAdminTestJSON-1023854658 None] Lock "cinder-quobyte-13e03ed3-4ac0-4300-b7c7-b260d85283f6" released by "delete_volume" :: held 2.175s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:43:13 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-a92afd2e-ef4a-4139-8463-183dfb3aacca tempest-VolumeQuotasAdminTestJSON-1023854658 None] Created reservations ['81fcd063-aec7-4e45-be2a-5cf49b06f0db', '7ae5a95c-b8a9-40ea-bc3e-0fec0b5d5042', 'b1f3310b-e2ae-4294-b520-400edce3ec34', 'd54229b0-53cd-42d6-920f-854918052914'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:43:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a92afd2e-ef4a-4139-8463-183dfb3aacca tempest-VolumeQuotasAdminTestJSON-1023854658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:43:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a92afd2e-ef4a-4139-8463-183dfb3aacca tempest-VolumeQuotasAdminTestJSON-1023854658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:43:13 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a92afd2e-ef4a-4139-8463-183dfb3aacca tempest-VolumeQuotasAdminTestJSON-1023854658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:43:13 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a92afd2e-ef4a-4139-8463-183dfb3aacca tempest-VolumeQuotasAdminTestJSON-1023854658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:43:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a92afd2e-ef4a-4139-8463-183dfb3aacca tempest-VolumeQuotasAdminTestJSON-1023854658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:43:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a92afd2e-ef4a-4139-8463-183dfb3aacca tempest-VolumeQuotasAdminTestJSON-1023854658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:13 devstack sudo[95477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:43:13 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:14 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a92afd2e-ef4a-4139-8463-183dfb3aacca tempest-VolumeQuotasAdminTestJSON-1023854658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.049s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:14 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-a92afd2e-ef4a-4139-8463-183dfb3aacca tempest-VolumeQuotasAdminTestJSON-1023854658 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:43:14 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-a92afd2e-ef4a-4139-8463-183dfb3aacca tempest-VolumeQuotasAdminTestJSON-1023854658 None] Deleted volume successfully.
Jun 26 05:43:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a92afd2e-ef4a-4139-8463-183dfb3aacca tempest-VolumeQuotasAdminTestJSON-1023854658 None] Lock "cinder-13e03ed3-4ac0-4300-b7c7-b260d85283f6-delete_volume" released by "delete_volume" :: held 3.553s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Flow 'volume_create_manager' (db6c7372-32bb-421d-83dc-2c6a24939363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90920f97-51f8-4c45-98ab-2a2bfee037cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90920f97-51f8-4c45-98ab-2a2bfee037cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-645206877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d59d7292-f6a3-4540-8a89-257b7507dbfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d19dac6ac5c4855af6fc787e7f90901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:43:17Z,use_quota=True,user_id='d7e1a68d75a845868673bf62a78fe86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6392b104-532e-4345-aaa0-84ea2dfd760f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6392b104-532e-4345-aaa0-84ea2dfd760f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db4eb6ab-be01-46b8-bc7f-0e1c7b09988e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db4eb6ab-be01-46b8-bc7f-0e1c7b09988e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd59d7292-f6a3-4540-8a89-257b7507dbfe', 'volume_name': 'volume-d59d7292-f6a3-4540-8a89-257b7507dbfe', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0570c04-277d-416a-9773-7b8ebba1b659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0570c04-277d-416a-9773-7b8ebba1b659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fa2e8f-804d-4ac6-88d7-5004bd4ac67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:16 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Volume d59d7292-f6a3-4540-8a89-257b7507dbfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d59d7292-f6a3-4540-8a89-257b7507dbfe', 'volume_size': 1}
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-645206877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d59d7292-f6a3-4540-8a89-257b7507dbfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d19dac6ac5c4855af6fc787e7f90901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:43:17Z,use_quota=True,user_id='d7e1a68d75a845868673bf62a78fe86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Creating volume d59d7292-f6a3-4540-8a89-257b7507dbfe {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:43:16 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:43:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d59d7292-f6a3-4540-8a89-257b7507dbfe 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:17 devstack sudo[95522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d59d7292-f6a3-4540-8a89-257b7507dbfe 1073741824
Jun 26 05:43:17 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:18 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d59d7292-f6a3-4540-8a89-257b7507dbfe 1073741824" returned: 0 in 1.535s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d59d7292-f6a3-4540-8a89-257b7507dbfe {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:18 devstack sudo[95530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d59d7292-f6a3-4540-8a89-257b7507dbfe
Jun 26 05:43:18 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:19 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d59d7292-f6a3-4540-8a89-257b7507dbfe" returned: 0 in 1.038s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:19 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] <== create_volume: return (2658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:43:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.660s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:43:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fa2e8f-804d-4ac6-88d7-5004bd4ac67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d59d7292-f6a3-4540-8a89-257b7507dbfe', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c027696-c21b-42e6-8b14-b0d370343391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:19 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Volume volume-d59d7292-f6a3-4540-8a89-257b7507dbfe (d59d7292-f6a3-4540-8a89-257b7507dbfe): created successfully
Jun 26 05:43:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c027696-c21b-42e6-8b14-b0d370343391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Flow 'volume_create_manager' (db6c7372-32bb-421d-83dc-2c6a24939363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:43:19 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-6c051bbd-9750-4b48-9e57-7594277e6c6a tempest-VolumesAdminNegativeTest-1066044051 None] Created volume successfully.
Jun 26 05:43:20 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-176d11d9-9397-4e9e-8622-ad07e437d3fb tempest-VolumesAdminNegativeTest-1066044051 None] Acquiring lock "cinder-d59d7292-f6a3-4540-8a89-257b7507dbfe-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:43:20 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-176d11d9-9397-4e9e-8622-ad07e437d3fb tempest-VolumesAdminNegativeTest-1066044051 None] Lock "cinder-d59d7292-f6a3-4540-8a89-257b7507dbfe-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:43:20 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-176d11d9-9397-4e9e-8622-ad07e437d3fb tempest-VolumesAdminNegativeTest-1066044051 None] Acquiring lock "cinder-quobyte-d59d7292-f6a3-4540-8a89-257b7507dbfe" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:43:20 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-176d11d9-9397-4e9e-8622-ad07e437d3fb tempest-VolumesAdminNegativeTest-1066044051 None] Lock "cinder-quobyte-d59d7292-f6a3-4540-8a89-257b7507dbfe" acquired by "delete_volume" :: waited 0.024s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:43:20 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[787887e7-399c-4932-9a4f-a24e401c25d2]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:43:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-176d11d9-9397-4e9e-8622-ad07e437d3fb tempest-VolumesAdminNegativeTest-1066044051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d59d7292-f6a3-4540-8a89-257b7507dbfe {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:21 devstack sudo[95533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d59d7292-f6a3-4540-8a89-257b7507dbfe
Jun 26 05:43:21 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:21 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-176d11d9-9397-4e9e-8622-ad07e437d3fb tempest-VolumesAdminNegativeTest-1066044051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d59d7292-f6a3-4540-8a89-257b7507dbfe" returned: 0 in 0.929s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-176d11d9-9397-4e9e-8622-ad07e437d3fb tempest-VolumesAdminNegativeTest-1066044051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d59d7292-f6a3-4540-8a89-257b7507dbfe {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:21 devstack sudo[95542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d59d7292-f6a3-4540-8a89-257b7507dbfe
Jun 26 05:43:21 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:22 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-176d11d9-9397-4e9e-8622-ad07e437d3fb tempest-VolumesAdminNegativeTest-1066044051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d59d7292-f6a3-4540-8a89-257b7507dbfe" returned: 0 in 0.952s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:22 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-176d11d9-9397-4e9e-8622-ad07e437d3fb tempest-VolumesAdminNegativeTest-1066044051 None] Lock "cinder-quobyte-d59d7292-f6a3-4540-8a89-257b7507dbfe" released by "delete_volume" :: held 1.965s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:43:23 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-176d11d9-9397-4e9e-8622-ad07e437d3fb tempest-VolumesAdminNegativeTest-1066044051 None] Created reservations ['fa2a5208-f6e0-4538-8f6a-5904313b1170', '4aeeaffe-32e6-45b3-8e37-f65eea91646c', '572f6eb0-0f4b-4e2f-a3ba-8375947f04f8', '06540f73-d688-4db4-b8ce-c0e0d0b04ba2'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:43:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-176d11d9-9397-4e9e-8622-ad07e437d3fb tempest-VolumesAdminNegativeTest-1066044051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:43:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-176d11d9-9397-4e9e-8622-ad07e437d3fb tempest-VolumesAdminNegativeTest-1066044051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:43:23 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-176d11d9-9397-4e9e-8622-ad07e437d3fb tempest-VolumesAdminNegativeTest-1066044051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:43:23 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-176d11d9-9397-4e9e-8622-ad07e437d3fb tempest-VolumesAdminNegativeTest-1066044051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:43:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-176d11d9-9397-4e9e-8622-ad07e437d3fb tempest-VolumesAdminNegativeTest-1066044051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:43:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-176d11d9-9397-4e9e-8622-ad07e437d3fb tempest-VolumesAdminNegativeTest-1066044051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:23 devstack sudo[95545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:43:23 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:24 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-176d11d9-9397-4e9e-8622-ad07e437d3fb tempest-VolumesAdminNegativeTest-1066044051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.433s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:24 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-176d11d9-9397-4e9e-8622-ad07e437d3fb tempest-VolumesAdminNegativeTest-1066044051 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:43:24 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-176d11d9-9397-4e9e-8622-ad07e437d3fb tempest-VolumesAdminNegativeTest-1066044051 None] Deleted volume successfully.
Jun 26 05:43:24 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-176d11d9-9397-4e9e-8622-ad07e437d3fb tempest-VolumesAdminNegativeTest-1066044051 None] Lock "cinder-d59d7292-f6a3-4540-8a89-257b7507dbfe-delete_volume" released by "delete_volume" :: held 3.917s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:43:30 devstack cinder-volume[93708]: WARNING py.warnings [req-1ea62c42-5ebc-490e-9db9-0e10ff297308 req-96ebb99b-5c80-4e06-9560-4d54753b5a4e tempest-ServerActionsTestOtherA-2094131569 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Jun 26 05:43:30 devstack cinder-volume[93708]:   .first()
Jun 26 05:43:30 devstack cinder-volume[93708]: 
Jun 26 05:43:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-1ea62c42-5ebc-490e-9db9-0e10ff297308 req-96ebb99b-5c80-4e06-9560-4d54753b5a4e tempest-ServerActionsTestOtherA-2094131569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:43:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-1ea62c42-5ebc-490e-9db9-0e10ff297308 req-96ebb99b-5c80-4e06-9560-4d54753b5a4e tempest-ServerActionsTestOtherA-2094131569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:43:30 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4d4d2f-253a-4d87-997e-e0526a391693]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:43:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-1ea62c42-5ebc-490e-9db9-0e10ff297308 req-96ebb99b-5c80-4e06-9560-4d54753b5a4e tempest-ServerActionsTestOtherA-2094131569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63ec2b25-b2b9-4e93-8640-da6104b7a633 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:30 devstack sudo[95638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63ec2b25-b2b9-4e93-8640-da6104b7a633
Jun 26 05:43:30 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:31 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-1ea62c42-5ebc-490e-9db9-0e10ff297308 req-96ebb99b-5c80-4e06-9560-4d54753b5a4e tempest-ServerActionsTestOtherA-2094131569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63ec2b25-b2b9-4e93-8640-da6104b7a633" returned: 0 in 0.840s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-1ea62c42-5ebc-490e-9db9-0e10ff297308 req-96ebb99b-5c80-4e06-9560-4d54753b5a4e tempest-ServerActionsTestOtherA-2094131569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.866s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:43:31 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-1ea62c42-5ebc-490e-9db9-0e10ff297308 req-96ebb99b-5c80-4e06-9560-4d54753b5a4e tempest-ServerActionsTestOtherA-2094131569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85', 'name': 'volume-63ec2b25-b2b9-4e93-8640-da6104b7a633', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9afae19e-3573-4dac-ab26-6d107df067e5', 'enforce_multipath': True} {{(pid=93708) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 05:43:31 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-1ea62c42-5ebc-490e-9db9-0e10ff297308 req-96ebb99b-5c80-4e06-9560-4d54753b5a4e tempest-ServerActionsTestOtherA-2094131569 None] attachment_update completed successfully.
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Flow 'volume_create_manager' (4e06a481-4ac4-45e1-869e-74b50c49e12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e131a4-3531-4753-a7e3-57c3d2a50d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e131a4-3531-4753-a7e3-57c3d2a50d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1761364554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=764d357e-5b37-4f4e-8e17-f0afd5277418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc02ad4d418b41518548d7eb64e69eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:43:37Z,use_quota=True,user_id='0100e466f4f14e9a831ae10beb0769c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b52e578-9281-4f40-be54-ac0b5a8bfb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b52e578-9281-4f40-be54-ac0b5a8bfb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d9ba79-7227-4e56-854c-54799727a171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d9ba79-7227-4e56-854c-54799727a171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '764d357e-5b37-4f4e-8e17-f0afd5277418', 'volume_name': 'volume-764d357e-5b37-4f4e-8e17-f0afd5277418', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee773ead-b875-4c51-8a6a-9f5cc1ba7fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee773ead-b875-4c51-8a6a-9f5cc1ba7fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e2595b-00b5-44dc-9049-1349608d7ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:36 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Volume 764d357e-5b37-4f4e-8e17-f0afd5277418: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-764d357e-5b37-4f4e-8e17-f0afd5277418', 'volume_size': 1}
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1761364554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=764d357e-5b37-4f4e-8e17-f0afd5277418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc02ad4d418b41518548d7eb64e69eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:43:37Z,use_quota=True,user_id='0100e466f4f14e9a831ae10beb0769c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Creating volume 764d357e-5b37-4f4e-8e17-f0afd5277418 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:43:36 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:43:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-764d357e-5b37-4f4e-8e17-f0afd5277418 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:36 devstack sudo[96117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-764d357e-5b37-4f4e-8e17-f0afd5277418 1073741824
Jun 26 05:43:36 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:37 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-764d357e-5b37-4f4e-8e17-f0afd5277418 1073741824" returned: 0 in 1.168s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-764d357e-5b37-4f4e-8e17-f0afd5277418 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:37 devstack sudo[96124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-764d357e-5b37-4f4e-8e17-f0afd5277418
Jun 26 05:43:37 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:39 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-764d357e-5b37-4f4e-8e17-f0afd5277418" returned: 0 in 1.114s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] <== create_volume: return (2337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:43:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.340s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:43:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e2595b-00b5-44dc-9049-1349608d7ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-764d357e-5b37-4f4e-8e17-f0afd5277418', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83d4123-cf95-479b-bfb4-0505a73c6ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:39 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Volume volume-764d357e-5b37-4f4e-8e17-f0afd5277418 (764d357e-5b37-4f4e-8e17-f0afd5277418): created successfully
Jun 26 05:43:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83d4123-cf95-479b-bfb4-0505a73c6ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Flow 'volume_create_manager' (4e06a481-4ac4-45e1-869e-74b50c49e12b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:43:39 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e5c611bf-bf98-4528-b793-db514eca6d88 tempest-AbsoluteLimitsTests-2015780598 None] Created volume successfully.
Jun 26 05:43:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7ef0d5a7-a3fb-4462-827c-59c67162ac05 tempest-AbsoluteLimitsTests-2015780598 None] Acquiring lock "cinder-764d357e-5b37-4f4e-8e17-f0afd5277418-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:43:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7ef0d5a7-a3fb-4462-827c-59c67162ac05 tempest-AbsoluteLimitsTests-2015780598 None] Lock "cinder-764d357e-5b37-4f4e-8e17-f0afd5277418-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:43:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7ef0d5a7-a3fb-4462-827c-59c67162ac05 tempest-AbsoluteLimitsTests-2015780598 None] Acquiring lock "cinder-quobyte-764d357e-5b37-4f4e-8e17-f0afd5277418" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:43:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7ef0d5a7-a3fb-4462-827c-59c67162ac05 tempest-AbsoluteLimitsTests-2015780598 None] Lock "cinder-quobyte-764d357e-5b37-4f4e-8e17-f0afd5277418" acquired by "delete_volume" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:43:40 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0ca8b7-43f8-4eef-b43c-2fa48c5644b5]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:43:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7ef0d5a7-a3fb-4462-827c-59c67162ac05 tempest-AbsoluteLimitsTests-2015780598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-764d357e-5b37-4f4e-8e17-f0afd5277418 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:40 devstack sudo[96134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-764d357e-5b37-4f4e-8e17-f0afd5277418
Jun 26 05:43:40 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:42 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7ef0d5a7-a3fb-4462-827c-59c67162ac05 tempest-AbsoluteLimitsTests-2015780598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-764d357e-5b37-4f4e-8e17-f0afd5277418" returned: 0 in 1.558s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7ef0d5a7-a3fb-4462-827c-59c67162ac05 tempest-AbsoluteLimitsTests-2015780598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-764d357e-5b37-4f4e-8e17-f0afd5277418 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:42 devstack sudo[96148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-764d357e-5b37-4f4e-8e17-f0afd5277418
Jun 26 05:43:42 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:43 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7ef0d5a7-a3fb-4462-827c-59c67162ac05 tempest-AbsoluteLimitsTests-2015780598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-764d357e-5b37-4f4e-8e17-f0afd5277418" returned: 0 in 1.256s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:43 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7ef0d5a7-a3fb-4462-827c-59c67162ac05 tempest-AbsoluteLimitsTests-2015780598 None] Lock "cinder-quobyte-764d357e-5b37-4f4e-8e17-f0afd5277418" released by "delete_volume" :: held 2.918s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:43:43 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-712825ce-eecc-4570-87fa-fc1664ad69a6 req-0c363f73-ceda-4ac6-b790-9884df4f4faf tempest-ServerActionsTestOtherA-2094131569 None] Terminate volume connection completed successfully.
Jun 26 05:43:43 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-712825ce-eecc-4570-87fa-fc1664ad69a6 req-0c363f73-ceda-4ac6-b790-9884df4f4faf tempest-ServerActionsTestOtherA-2094131569 None] Deleting attachment 9afae19e-3573-4dac-ab26-6d107df067e5. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 05:43:43 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-7ef0d5a7-a3fb-4462-827c-59c67162ac05 tempest-AbsoluteLimitsTests-2015780598 None] Created reservations ['bf5fc86f-d6bb-4907-859a-9b2bdcff2b1c', '3e91dedc-8264-4282-a6f9-6b3eacb48558', '22a788ee-6e7e-4b13-b83d-5b1ddda889c4', '61602740-e882-4127-a0f7-bc146621b446'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:43:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7ef0d5a7-a3fb-4462-827c-59c67162ac05 tempest-AbsoluteLimitsTests-2015780598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:43:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7ef0d5a7-a3fb-4462-827c-59c67162ac05 tempest-AbsoluteLimitsTests-2015780598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:43:43 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7ef0d5a7-a3fb-4462-827c-59c67162ac05 tempest-AbsoluteLimitsTests-2015780598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:43:43 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7ef0d5a7-a3fb-4462-827c-59c67162ac05 tempest-AbsoluteLimitsTests-2015780598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:43:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7ef0d5a7-a3fb-4462-827c-59c67162ac05 tempest-AbsoluteLimitsTests-2015780598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:43:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7ef0d5a7-a3fb-4462-827c-59c67162ac05 tempest-AbsoluteLimitsTests-2015780598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:43 devstack sudo[96212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:43:43 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:44 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7ef0d5a7-a3fb-4462-827c-59c67162ac05 tempest-AbsoluteLimitsTests-2015780598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.980s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:44 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-7ef0d5a7-a3fb-4462-827c-59c67162ac05 tempest-AbsoluteLimitsTests-2015780598 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:43:44 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-7ef0d5a7-a3fb-4462-827c-59c67162ac05 tempest-AbsoluteLimitsTests-2015780598 None] Deleted volume successfully.
Jun 26 05:43:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7ef0d5a7-a3fb-4462-827c-59c67162ac05 tempest-AbsoluteLimitsTests-2015780598 None] Lock "cinder-764d357e-5b37-4f4e-8e17-f0afd5277418-delete_volume" released by "delete_volume" :: held 4.395s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:43:46 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=53,cinder:SELECT=34,cinder:INSERT=12,cinder:DELETE=4 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:43:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-712825ce-eecc-4570-87fa-fc1664ad69a6 req-3ca0f61f-33dc-465e-b94f-46cf2abd65e8 tempest-ServerActionsTestOtherA-2094131569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:43:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-712825ce-eecc-4570-87fa-fc1664ad69a6 req-3ca0f61f-33dc-465e-b94f-46cf2abd65e8 tempest-ServerActionsTestOtherA-2094131569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:43:46 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f59e01-9124-4c7e-9393-e10c1a869578]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:43:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-712825ce-eecc-4570-87fa-fc1664ad69a6 req-3ca0f61f-33dc-465e-b94f-46cf2abd65e8 tempest-ServerActionsTestOtherA-2094131569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63ec2b25-b2b9-4e93-8640-da6104b7a633 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:46 devstack sudo[96227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63ec2b25-b2b9-4e93-8640-da6104b7a633
Jun 26 05:43:46 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:47 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-712825ce-eecc-4570-87fa-fc1664ad69a6 req-3ca0f61f-33dc-465e-b94f-46cf2abd65e8 tempest-ServerActionsTestOtherA-2094131569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63ec2b25-b2b9-4e93-8640-da6104b7a633" returned: 0 in 1.135s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-712825ce-eecc-4570-87fa-fc1664ad69a6 req-3ca0f61f-33dc-465e-b94f-46cf2abd65e8 tempest-ServerActionsTestOtherA-2094131569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.190s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:43:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-712825ce-eecc-4570-87fa-fc1664ad69a6 req-3ca0f61f-33dc-465e-b94f-46cf2abd65e8 tempest-ServerActionsTestOtherA-2094131569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85', 'name': 'volume-63ec2b25-b2b9-4e93-8640-da6104b7a633', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a836fec2-657b-4bc2-b284-249c68a9f897', 'enforce_multipath': True} {{(pid=93708) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 05:43:47 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-712825ce-eecc-4570-87fa-fc1664ad69a6 req-3ca0f61f-33dc-465e-b94f-46cf2abd65e8 tempest-ServerActionsTestOtherA-2094131569 None] attachment_update completed successfully.
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Flow 'volume_create_manager' (17c3faac-8129-41f0-bbdd-a9f2da8e0fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118a0ae5-fafe-493b-b8bb-89085c0577ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118a0ae5-fafe-493b-b8bb-89085c0577ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2082108297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a38a6f-466e-4836-950e-bfed6d2d31da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9d99e0708834550a55c79224c72e5cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:43:50Z,use_quota=True,user_id='39e9f695b0f54fc382aec43e9185ddc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a9638b-74bd-46d8-a108-51165ea4ecbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a9638b-74bd-46d8-a108-51165ea4ecbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caca8f8e-df3a-44b8-8a5f-9da9e03b51f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caca8f8e-df3a-44b8-8a5f-9da9e03b51f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16a38a6f-466e-4836-950e-bfed6d2d31da', 'volume_name': 'volume-16a38a6f-466e-4836-950e-bfed6d2d31da', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3789d677-8217-4d17-ba1b-075b5e3b282f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3789d677-8217-4d17-ba1b-075b5e3b282f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f62fe07-80ec-46e5-bf68-e28d3b4d8795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:49 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Volume 16a38a6f-466e-4836-950e-bfed6d2d31da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16a38a6f-466e-4836-950e-bfed6d2d31da', 'volume_size': 1}
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2082108297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a38a6f-466e-4836-950e-bfed6d2d31da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9d99e0708834550a55c79224c72e5cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:43:50Z,use_quota=True,user_id='39e9f695b0f54fc382aec43e9185ddc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Creating volume 16a38a6f-466e-4836-950e-bfed6d2d31da {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:43:49 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:43:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16a38a6f-466e-4836-950e-bfed6d2d31da 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:49 devstack sudo[96255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16a38a6f-466e-4836-950e-bfed6d2d31da 1073741824
Jun 26 05:43:49 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:50 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16a38a6f-466e-4836-950e-bfed6d2d31da 1073741824" returned: 0 in 0.868s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16a38a6f-466e-4836-950e-bfed6d2d31da {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:50 devstack sudo[96272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16a38a6f-466e-4836-950e-bfed6d2d31da
Jun 26 05:43:50 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:51 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16a38a6f-466e-4836-950e-bfed6d2d31da" returned: 0 in 0.734s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:43:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:43:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f62fe07-80ec-46e5-bf68-e28d3b4d8795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16a38a6f-466e-4836-950e-bfed6d2d31da', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d6c67e-6c67-44ea-bdf9-94d90f6bd036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:51 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Volume volume-16a38a6f-466e-4836-950e-bfed6d2d31da (16a38a6f-466e-4836-950e-bfed6d2d31da): created successfully
Jun 26 05:43:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d6c67e-6c67-44ea-bdf9-94d90f6bd036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Flow 'volume_create_manager' (17c3faac-8129-41f0-bbdd-a9f2da8e0fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:43:51 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-ac27570b-2292-4f8f-91a3-f0e4824a49dd tempest-VolumesMetadataTest-13625551 None] Created volume successfully.
Jun 26 05:43:52 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0d25fca0-ac59-496e-8290-8a161d06e07e tempest-VolumesMetadataTest-13625551 None] Acquiring lock "cinder-16a38a6f-466e-4836-950e-bfed6d2d31da-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:43:52 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0d25fca0-ac59-496e-8290-8a161d06e07e tempest-VolumesMetadataTest-13625551 None] Lock "cinder-16a38a6f-466e-4836-950e-bfed6d2d31da-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:43:52 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0d25fca0-ac59-496e-8290-8a161d06e07e tempest-VolumesMetadataTest-13625551 None] Acquiring lock "cinder-quobyte-16a38a6f-466e-4836-950e-bfed6d2d31da" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:43:52 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0d25fca0-ac59-496e-8290-8a161d06e07e tempest-VolumesMetadataTest-13625551 None] Lock "cinder-quobyte-16a38a6f-466e-4836-950e-bfed6d2d31da" acquired by "delete_volume" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:43:52 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d42c92-57a0-49cc-86b5-b26bd7f24f5c]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:43:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0d25fca0-ac59-496e-8290-8a161d06e07e tempest-VolumesMetadataTest-13625551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16a38a6f-466e-4836-950e-bfed6d2d31da {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:52 devstack sudo[96346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16a38a6f-466e-4836-950e-bfed6d2d31da
Jun 26 05:43:52 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:53 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0d25fca0-ac59-496e-8290-8a161d06e07e tempest-VolumesMetadataTest-13625551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16a38a6f-466e-4836-950e-bfed6d2d31da" returned: 0 in 0.783s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0d25fca0-ac59-496e-8290-8a161d06e07e tempest-VolumesMetadataTest-13625551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16a38a6f-466e-4836-950e-bfed6d2d31da {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:53 devstack sudo[96667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16a38a6f-466e-4836-950e-bfed6d2d31da
Jun 26 05:43:53 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:54 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0d25fca0-ac59-496e-8290-8a161d06e07e tempest-VolumesMetadataTest-13625551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16a38a6f-466e-4836-950e-bfed6d2d31da" returned: 0 in 0.943s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:54 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0d25fca0-ac59-496e-8290-8a161d06e07e tempest-VolumesMetadataTest-13625551 None] Lock "cinder-quobyte-16a38a6f-466e-4836-950e-bfed6d2d31da" released by "delete_volume" :: held 1.795s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:43:54 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=48,cinder:INSERT=8,cinder:UPDATE=42,cinder:DELETE=5 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:43:54 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-0d25fca0-ac59-496e-8290-8a161d06e07e tempest-VolumesMetadataTest-13625551 None] Created reservations ['0551fc67-2757-48cc-8fda-29ef2fe926dd', '506d7f40-0500-467a-9377-a295736097bd', 'cfff0ded-5ae1-47a6-ae58-7add363c9fcd', '1c880040-e610-4a74-8a49-7e0238afc789'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:43:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0d25fca0-ac59-496e-8290-8a161d06e07e tempest-VolumesMetadataTest-13625551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:43:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0d25fca0-ac59-496e-8290-8a161d06e07e tempest-VolumesMetadataTest-13625551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:43:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-0d25fca0-ac59-496e-8290-8a161d06e07e tempest-VolumesMetadataTest-13625551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:43:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-0d25fca0-ac59-496e-8290-8a161d06e07e tempest-VolumesMetadataTest-13625551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:43:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0d25fca0-ac59-496e-8290-8a161d06e07e tempest-VolumesMetadataTest-13625551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:43:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0d25fca0-ac59-496e-8290-8a161d06e07e tempest-VolumesMetadataTest-13625551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:43:54 devstack sudo[96717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:43:54 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:43:55 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root
Jun 26 05:43:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0d25fca0-ac59-496e-8290-8a161d06e07e tempest-VolumesMetadataTest-13625551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.094s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:43:55 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-0d25fca0-ac59-496e-8290-8a161d06e07e tempest-VolumesMetadataTest-13625551 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:43:55 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-0d25fca0-ac59-496e-8290-8a161d06e07e tempest-VolumesMetadataTest-13625551 None] Deleted volume successfully.
Jun 26 05:43:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0d25fca0-ac59-496e-8290-8a161d06e07e tempest-VolumesMetadataTest-13625551 None] Lock "cinder-16a38a6f-466e-4836-950e-bfed6d2d31da-delete_volume" released by "delete_volume" :: held 3.307s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:43:59 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:43:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Flow 'volume_create_manager' (11dcdbaa-7389-4667-bbc4-bd2fbc9ce68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:43:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16568c22-3bc5-462d-b2ca-157c4b3f74b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16568c22-3bc5-462d-b2ca-157c4b3f74b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-765330915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e2f3cf-411a-4a40-abe2-ec59b567f3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ade7f7d05b834752820bd9077915483a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:44:00Z,use_quota=True,user_id='3c4eec2508804a46a8c8ac2c45dba0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c6ace55-6b91-43c3-9973-8f666f3b9eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c6ace55-6b91-43c3-9973-8f666f3b9eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8bc5e2-89a3-47d2-95e5-d6676aeeb32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8bc5e2-89a3-47d2-95e5-d6676aeeb32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37e2f3cf-411a-4a40-abe2-ec59b567f3b4', 'volume_name': 'volume-37e2f3cf-411a-4a40-abe2-ec59b567f3b4', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2864c96e-2a30-4c5c-9cca-9df489bcb9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2864c96e-2a30-4c5c-9cca-9df489bcb9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:43:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ebabe2-ddaa-463d-9cdf-db7c4b91cbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:43:59 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Volume 37e2f3cf-411a-4a40-abe2-ec59b567f3b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37e2f3cf-411a-4a40-abe2-ec59b567f3b4', 'volume_size': 1}
Jun 26 05:43:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:43:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:43:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-765330915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e2f3cf-411a-4a40-abe2-ec59b567f3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ade7f7d05b834752820bd9077915483a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:44:00Z,use_quota=True,user_id='3c4eec2508804a46a8c8ac2c45dba0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:43:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Creating volume 37e2f3cf-411a-4a40-abe2-ec59b567f3b4 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:43:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:43:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:43:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:44:00 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:44:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:00 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:44:00 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:44:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-37e2f3cf-411a-4a40-abe2-ec59b567f3b4 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:00 devstack sudo[96760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-37e2f3cf-411a-4a40-abe2-ec59b567f3b4 1073741824
Jun 26 05:44:00 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:01 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-37e2f3cf-411a-4a40-abe2-ec59b567f3b4 1073741824" returned: 0 in 1.191s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-37e2f3cf-411a-4a40-abe2-ec59b567f3b4 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:01 devstack sudo[96768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-37e2f3cf-411a-4a40-abe2-ec59b567f3b4
Jun 26 05:44:01 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:02 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-37e2f3cf-411a-4a40-abe2-ec59b567f3b4" returned: 0 in 1.355s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] <== create_volume: return (2653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.657s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ebabe2-ddaa-463d-9cdf-db7c4b91cbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37e2f3cf-411a-4a40-abe2-ec59b567f3b4', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26b2870-bfef-47b8-87b1-f913e93f2328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:02 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Volume volume-37e2f3cf-411a-4a40-abe2-ec59b567f3b4 (37e2f3cf-411a-4a40-abe2-ec59b567f3b4): created successfully
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26b2870-bfef-47b8-87b1-f913e93f2328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Flow 'volume_create_manager' (11dcdbaa-7389-4667-bbc4-bd2fbc9ce68c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:44:02 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e154dd00-2ccb-460f-9c4e-e33cec9399c4 tempest-AttachVolumeShelveTestJSON-1307149475 None] Created volume successfully.
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Flow 'volume_create_manager' (3fb922d6-3150-4d9b-a995-2ea89227b034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b721421-d1f6-4d19-9391-65f8deb5e64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b721421-d1f6-4d19-9391-65f8deb5e64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-930271873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc070995-4f80-4ff9-9ab7-f4ef0334ecd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b99de4f45b7844dd951356d8e5b70763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:44:03Z,use_quota=True,user_id='462aad9ac5fe477c820777362cec2f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee99571-433c-4515-86fd-816fdd6d6d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee99571-433c-4515-86fd-816fdd6d6d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95e3cb8-9082-495c-9eeb-23898fadb3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95e3cb8-9082-495c-9eeb-23898fadb3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc070995-4f80-4ff9-9ab7-f4ef0334ecd8', 'volume_name': 'volume-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95589fe3-0a8f-4c04-803a-b8355603a4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95589fe3-0a8f-4c04-803a-b8355603a4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94eff738-6271-4588-9bfa-e159568b88f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:02 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Volume dc070995-4f80-4ff9-9ab7-f4ef0334ecd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8', 'volume_size': 1}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-930271873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc070995-4f80-4ff9-9ab7-f4ef0334ecd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b99de4f45b7844dd951356d8e5b70763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:44:03Z,use_quota=True,user_id='462aad9ac5fe477c820777362cec2f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Creating volume dc070995-4f80-4ff9-9ab7-f4ef0334ecd8 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:44:02 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:44:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:02 devstack sudo[96772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8 1073741824
Jun 26 05:44:02 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:04 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8 1073741824" returned: 0 in 1.377s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:04 devstack sudo[96785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8
Jun 26 05:44:04 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:05 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8" returned: 0 in 1.107s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:05 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] <== create_volume: return (2581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:44:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.584s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94eff738-6271-4588-9bfa-e159568b88f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6f9eff-0122-4f33-a0c0-9b8186e10fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:05 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Volume volume-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8 (dc070995-4f80-4ff9-9ab7-f4ef0334ecd8): created successfully
Jun 26 05:44:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6f9eff-0122-4f33-a0c0-9b8186e10fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Flow 'volume_create_manager' (3fb922d6-3150-4d9b-a995-2ea89227b034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:44:05 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-7e3e24df-75f7-4fad-89b6-0e1d0fa13e52 tempest-VolumesTransfersTest-2025878747 None] Created volume successfully.
Jun 26 05:44:07 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-1f0398ce-1875-49a0-8a5e-bfbd9608d44f tempest-VolumesTransfersTest-1229473298 None] Transfer volume completed successfully.
Jun 26 05:44:08 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-49aa0c64-4575-4d46-aa47-0d9611b95312 tempest-VolumesTransfersTest-1604822202 None] Acquiring lock "cinder-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:44:08 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-49aa0c64-4575-4d46-aa47-0d9611b95312 tempest-VolumesTransfersTest-1604822202 None] Lock "cinder-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:44:08 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-49aa0c64-4575-4d46-aa47-0d9611b95312 tempest-VolumesTransfersTest-1604822202 None] Acquiring lock "cinder-quobyte-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:44:08 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-49aa0c64-4575-4d46-aa47-0d9611b95312 tempest-VolumesTransfersTest-1604822202 None] Lock "cinder-quobyte-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8" acquired by "delete_volume" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:44:08 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8e6a1e-7e46-43b9-96f2-095285bd5f6b]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:44:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-49aa0c64-4575-4d46-aa47-0d9611b95312 tempest-VolumesTransfersTest-1604822202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:08 devstack sudo[96842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8
Jun 26 05:44:08 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:09 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-49aa0c64-4575-4d46-aa47-0d9611b95312 tempest-VolumesTransfersTest-1604822202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8" returned: 0 in 0.948s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-49aa0c64-4575-4d46-aa47-0d9611b95312 tempest-VolumesTransfersTest-1604822202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:09 devstack sudo[96879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8
Jun 26 05:44:09 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:10 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-49aa0c64-4575-4d46-aa47-0d9611b95312 tempest-VolumesTransfersTest-1604822202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8" returned: 0 in 0.722s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:10 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-49aa0c64-4575-4d46-aa47-0d9611b95312 tempest-VolumesTransfersTest-1604822202 None] Lock "cinder-quobyte-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8" released by "delete_volume" :: held 1.733s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:44:10 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-49aa0c64-4575-4d46-aa47-0d9611b95312 tempest-VolumesTransfersTest-1604822202 None] Created reservations ['08b8210d-98c0-4d20-aa22-92c5bfa2dcf2', '051d9236-d5c3-43a1-9b26-f2ce3a6082a2', '6cab0b3c-b01e-4405-a37f-dc9f34f591f8', 'd4d83b3a-039e-475d-9a31-53505c4f15cf'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:44:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-49aa0c64-4575-4d46-aa47-0d9611b95312 tempest-VolumesTransfersTest-1604822202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:44:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-49aa0c64-4575-4d46-aa47-0d9611b95312 tempest-VolumesTransfersTest-1604822202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:44:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-49aa0c64-4575-4d46-aa47-0d9611b95312 tempest-VolumesTransfersTest-1604822202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:44:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-49aa0c64-4575-4d46-aa47-0d9611b95312 tempest-VolumesTransfersTest-1604822202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:44:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-49aa0c64-4575-4d46-aa47-0d9611b95312 tempest-VolumesTransfersTest-1604822202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-49aa0c64-4575-4d46-aa47-0d9611b95312 tempest-VolumesTransfersTest-1604822202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:10 devstack sudo[96883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:44:10 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:44:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:44:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:44:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:44:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:44:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:10 devstack sudo[96885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:44:10 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:11 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-49aa0c64-4575-4d46-aa47-0d9611b95312 tempest-VolumesTransfersTest-1604822202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.960s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-49aa0c64-4575-4d46-aa47-0d9611b95312 tempest-VolumesTransfersTest-1604822202 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:44:11 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-49aa0c64-4575-4d46-aa47-0d9611b95312 tempest-VolumesTransfersTest-1604822202 None] Deleted volume successfully.
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-49aa0c64-4575-4d46-aa47-0d9611b95312 tempest-VolumesTransfersTest-1604822202 None] Lock "cinder-dc070995-4f80-4ff9-9ab7-f4ef0334ecd8-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:44:11 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.147s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 8 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Flow 'volume_create_manager' (6b97c79a-e8ad-4463-b817-79495d212944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c9460a-3d46-4a78-b84b-11fe07501038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c9460a-3d46-4a78-b84b-11fe07501038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1741873168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafff99a-422f-4022-a901-e345416bc997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b99de4f45b7844dd951356d8e5b70763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:44:12Z,use_quota=True,user_id='462aad9ac5fe477c820777362cec2f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb437d3-7fe8-411e-82c2-4bb5d92768f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb437d3-7fe8-411e-82c2-4bb5d92768f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef875315-df80-47bf-8b1c-dab12f59d1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef875315-df80-47bf-8b1c-dab12f59d1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dafff99a-422f-4022-a901-e345416bc997', 'volume_name': 'volume-dafff99a-422f-4022-a901-e345416bc997', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cde29f8-2998-41c9-bd63-b5e86b9b9f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cde29f8-2998-41c9-bd63-b5e86b9b9f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5128b543-81f1-42c7-9e3b-8d9c62da9127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:11 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Volume dafff99a-422f-4022-a901-e345416bc997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dafff99a-422f-4022-a901-e345416bc997', 'volume_size': 1}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1741873168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafff99a-422f-4022-a901-e345416bc997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b99de4f45b7844dd951356d8e5b70763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:44:12Z,use_quota=True,user_id='462aad9ac5fe477c820777362cec2f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Creating volume dafff99a-422f-4022-a901-e345416bc997 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:44:11 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:44:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dafff99a-422f-4022-a901-e345416bc997 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:12 devstack sudo[96921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dafff99a-422f-4022-a901-e345416bc997 1073741824
Jun 26 05:44:12 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:12 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dafff99a-422f-4022-a901-e345416bc997 1073741824" returned: 0 in 0.880s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dafff99a-422f-4022-a901-e345416bc997 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:12 devstack sudo[96927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dafff99a-422f-4022-a901-e345416bc997
Jun 26 05:44:12 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:13 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dafff99a-422f-4022-a901-e345416bc997" returned: 0 in 0.720s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:13 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:44:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:13 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5128b543-81f1-42c7-9e3b-8d9c62da9127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dafff99a-422f-4022-a901-e345416bc997', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:13 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77261359-3804-49f3-aae7-d8c0b2ffbea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:13 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Volume volume-dafff99a-422f-4022-a901-e345416bc997 (dafff99a-422f-4022-a901-e345416bc997): created successfully
Jun 26 05:44:13 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77261359-3804-49f3-aae7-d8c0b2ffbea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:13 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Flow 'volume_create_manager' (6b97c79a-e8ad-4463-b817-79495d212944) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:44:13 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-483ae22e-6908-45ca-9cb0-e023037b24a1 tempest-VolumesTransfersTest-2025878747 None] Created volume successfully.
Jun 26 05:44:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-92410c1e-b1e7-4ee3-8a98-af8e8047a56a tempest-VolumesTransfersTest-1604822202 None] Acquiring lock "cinder-dafff99a-422f-4022-a901-e345416bc997-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:44:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-92410c1e-b1e7-4ee3-8a98-af8e8047a56a tempest-VolumesTransfersTest-1604822202 None] Lock "cinder-dafff99a-422f-4022-a901-e345416bc997-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:44:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-92410c1e-b1e7-4ee3-8a98-af8e8047a56a tempest-VolumesTransfersTest-1604822202 None] Acquiring lock "cinder-quobyte-dafff99a-422f-4022-a901-e345416bc997" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:44:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-92410c1e-b1e7-4ee3-8a98-af8e8047a56a tempest-VolumesTransfersTest-1604822202 None] Lock "cinder-quobyte-dafff99a-422f-4022-a901-e345416bc997" acquired by "delete_volume" :: waited 0.019s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:44:14 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df3b75c-e069-4539-9471-7218330b0d8d]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:44:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-92410c1e-b1e7-4ee3-8a98-af8e8047a56a tempest-VolumesTransfersTest-1604822202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dafff99a-422f-4022-a901-e345416bc997 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:14 devstack sudo[96930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dafff99a-422f-4022-a901-e345416bc997
Jun 26 05:44:14 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:15 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-92410c1e-b1e7-4ee3-8a98-af8e8047a56a tempest-VolumesTransfersTest-1604822202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dafff99a-422f-4022-a901-e345416bc997" returned: 0 in 0.769s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-92410c1e-b1e7-4ee3-8a98-af8e8047a56a tempest-VolumesTransfersTest-1604822202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dafff99a-422f-4022-a901-e345416bc997 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:15 devstack sudo[96937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dafff99a-422f-4022-a901-e345416bc997
Jun 26 05:44:15 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:16 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-92410c1e-b1e7-4ee3-8a98-af8e8047a56a tempest-VolumesTransfersTest-1604822202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dafff99a-422f-4022-a901-e345416bc997" returned: 0 in 1.063s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-92410c1e-b1e7-4ee3-8a98-af8e8047a56a tempest-VolumesTransfersTest-1604822202 None] Lock "cinder-quobyte-dafff99a-422f-4022-a901-e345416bc997" released by "delete_volume" :: held 1.888s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:44:16 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-92410c1e-b1e7-4ee3-8a98-af8e8047a56a tempest-VolumesTransfersTest-1604822202 None] Created reservations ['1808d9ba-fed0-435e-abf7-7f36c839de6c', 'ff11d90d-4b14-41e5-a051-2037445606e1', '06f00dfd-61be-4ac2-997b-679fcdfbc95c', 'e8fdabd5-b582-42a8-b3fd-ca60d38d87e1'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:44:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-92410c1e-b1e7-4ee3-8a98-af8e8047a56a tempest-VolumesTransfersTest-1604822202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:44:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-92410c1e-b1e7-4ee3-8a98-af8e8047a56a tempest-VolumesTransfersTest-1604822202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:44:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-92410c1e-b1e7-4ee3-8a98-af8e8047a56a tempest-VolumesTransfersTest-1604822202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:44:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-92410c1e-b1e7-4ee3-8a98-af8e8047a56a tempest-VolumesTransfersTest-1604822202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:44:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-92410c1e-b1e7-4ee3-8a98-af8e8047a56a tempest-VolumesTransfersTest-1604822202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-92410c1e-b1e7-4ee3-8a98-af8e8047a56a tempest-VolumesTransfersTest-1604822202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:16 devstack sudo[96976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:44:16 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:17 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-92410c1e-b1e7-4ee3-8a98-af8e8047a56a tempest-VolumesTransfersTest-1604822202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.011s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:17 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-92410c1e-b1e7-4ee3-8a98-af8e8047a56a tempest-VolumesTransfersTest-1604822202 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:44:17 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-92410c1e-b1e7-4ee3-8a98-af8e8047a56a tempest-VolumesTransfersTest-1604822202 None] Deleted volume successfully.
Jun 26 05:44:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-92410c1e-b1e7-4ee3-8a98-af8e8047a56a tempest-VolumesTransfersTest-1604822202 None] Lock "cinder-dafff99a-422f-4022-a901-e345416bc997-delete_volume" released by "delete_volume" :: held 3.227s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:44:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-78159e50-dd4c-4b3d-aa72-8ab00063725c req-873f6e3e-b300-4562-94ff-03a60b510da7 tempest-AttachVolumeShelveTestJSON-1307149475 None] No connector for attachment cd99ef1f-329a-494c-9e5c-28578c2aa7fb; skipping storage backend terminate_connection call. {{(pid=93708) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jun 26 05:44:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-78159e50-dd4c-4b3d-aa72-8ab00063725c req-873f6e3e-b300-4562-94ff-03a60b510da7 tempest-AttachVolumeShelveTestJSON-1307149475 None] Deleting attachment cd99ef1f-329a-494c-9e5c-28578c2aa7fb. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 05:44:21 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-fe52fcfd-650b-457e-a93f-86a7698b4e16 req-7f7e5fd4-d60d-490a-82f5-72a69f6ae83b tempest-ServerActionsTestOtherA-2094131569 None] Terminate volume connection completed successfully.
Jun 26 05:44:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-fe52fcfd-650b-457e-a93f-86a7698b4e16 req-7f7e5fd4-d60d-490a-82f5-72a69f6ae83b tempest-ServerActionsTestOtherA-2094131569 None] Deleting attachment a836fec2-657b-4bc2-b284-249c68a9f897. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 05:44:26 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:44:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Flow 'volume_create_manager' (a2a1015f-ba95-4189-a81b-9dbbf004ff72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:44:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85d4e8b-d0c2-4855-8e8d-cc9a585a2de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85d4e8b-d0c2-4855-8e8d-cc9a585a2de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-642522119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f766ca-e480-42f5-9be6-9c407aefaf4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70858d5f35be4266afffb27d95b4127d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:44:27Z,use_quota=True,user_id='d92953dc2c0c40e5add38b7a784b0e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e26ac5-c371-4606-9295-ebbc4cc7c7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e26ac5-c371-4606-9295-ebbc4cc7c7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a2ee01-c5ca-43b2-8c79-489b0cbd1acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a2ee01-c5ca-43b2-8c79-489b0cbd1acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52f766ca-e480-42f5-9be6-9c407aefaf4c', 'volume_name': 'volume-52f766ca-e480-42f5-9be6-9c407aefaf4c', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25acbd4-c9d2-474a-a49b-bb2969a95f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25acbd4-c9d2-474a-a49b-bb2969a95f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf2cc44-a41c-44a8-992a-80191b79a869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:27 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Volume 52f766ca-e480-42f5-9be6-9c407aefaf4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52f766ca-e480-42f5-9be6-9c407aefaf4c', 'volume_size': 1}
Jun 26 05:44:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:44:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:44:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-642522119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f766ca-e480-42f5-9be6-9c407aefaf4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70858d5f35be4266afffb27d95b4127d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:44:27Z,use_quota=True,user_id='d92953dc2c0c40e5add38b7a784b0e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:44:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Creating volume 52f766ca-e480-42f5-9be6-9c407aefaf4c {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:44:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:44:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:44:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:44:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:44:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:44:27 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:44:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-52f766ca-e480-42f5-9be6-9c407aefaf4c 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:27 devstack sudo[97163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-52f766ca-e480-42f5-9be6-9c407aefaf4c 1073741824
Jun 26 05:44:27 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:28 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-52f766ca-e480-42f5-9be6-9c407aefaf4c 1073741824" returned: 0 in 1.319s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-52f766ca-e480-42f5-9be6-9c407aefaf4c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:28 devstack sudo[97173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-52f766ca-e480-42f5-9be6-9c407aefaf4c
Jun 26 05:44:28 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:29 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-52f766ca-e480-42f5-9be6-9c407aefaf4c" returned: 0 in 0.696s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:44:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:29 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf2cc44-a41c-44a8-992a-80191b79a869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52f766ca-e480-42f5-9be6-9c407aefaf4c', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:29 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3917bd-b576-4ff4-ac81-fb546355139d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:29 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Volume volume-52f766ca-e480-42f5-9be6-9c407aefaf4c (52f766ca-e480-42f5-9be6-9c407aefaf4c): created successfully
Jun 26 05:44:29 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3917bd-b576-4ff4-ac81-fb546355139d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:29 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Flow 'volume_create_manager' (a2a1015f-ba95-4189-a81b-9dbbf004ff72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:44:29 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-f933ef58-4137-494d-864e-3a9424fa4e82 tempest-VolumesTransfersV355Test-1225711916 None] Created volume successfully.
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Flow 'volume_create_manager' (c2efbbda-f4c2-41f0-8edc-661bde8e8ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b56776c-7fc8-4bc3-84c2-54d1d96d85fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b56776c-7fc8-4bc3-84c2-54d1d96d85fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-118151771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25a9b98a0e42491aa1e75faf67ad3022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:44:30Z,use_quota=True,user_id='d1609499ac964e4688debd38b9f1bdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff8c511-e124-43df-853f-47c597cfc470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff8c511-e124-43df-853f-47c597cfc470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b222ff-5ce6-4881-80f9-447cd3773d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b222ff-5ce6-4881-80f9-447cd3773d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1', 'volume_name': 'volume-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08422978-728a-4a18-b3a0-c33e0f22e22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08422978-728a-4a18-b3a0-c33e0f22e22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3535254-9f59-4157-9d50-5bf86ba901a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:30 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Volume 1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1', 'volume_size': 1}
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-118151771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25a9b98a0e42491aa1e75faf67ad3022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:44:30Z,use_quota=True,user_id='d1609499ac964e4688debd38b9f1bdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Creating volume 1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:44:30 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:44:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:30 devstack sudo[97177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1 1073741824
Jun 26 05:44:30 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:30 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-30a9dc12-91f1-40bf-af75-8e7f54635ce1 tempest-VolumesTransfersV355Test-118588769 None] Transfer volume completed successfully.
Jun 26 05:44:31 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1 1073741824" returned: 0 in 1.010s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:31 devstack sudo[97183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1
Jun 26 05:44:31 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-b548be34-cd81-4a02-9333-658529ff25d3 tempest-VolumesTransfersV355Test-1178559414 None] Acquiring lock "cinder-52f766ca-e480-42f5-9be6-9c407aefaf4c-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:44:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-b548be34-cd81-4a02-9333-658529ff25d3 tempest-VolumesTransfersV355Test-1178559414 None] Lock "cinder-52f766ca-e480-42f5-9be6-9c407aefaf4c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:44:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-b548be34-cd81-4a02-9333-658529ff25d3 tempest-VolumesTransfersV355Test-1178559414 None] Acquiring lock "cinder-quobyte-52f766ca-e480-42f5-9be6-9c407aefaf4c" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:44:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-b548be34-cd81-4a02-9333-658529ff25d3 tempest-VolumesTransfersV355Test-1178559414 None] Lock "cinder-quobyte-52f766ca-e480-42f5-9be6-9c407aefaf4c" acquired by "delete_volume" :: waited 0.017s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:44:32 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8a5041-11ca-4f4f-aed7-edd2bf762feb]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:44:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b548be34-cd81-4a02-9333-658529ff25d3 tempest-VolumesTransfersV355Test-1178559414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-52f766ca-e480-42f5-9be6-9c407aefaf4c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:32 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1" returned: 0 in 1.129s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:32 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] <== create_volume: return (2199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:44:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.202s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:32 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3535254-9f59-4157-9d50-5bf86ba901a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:32 devstack sudo[97187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-52f766ca-e480-42f5-9be6-9c407aefaf4c
Jun 26 05:44:32 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:32 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb519796-36f4-49f2-ac53-2e3a45274d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:32 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Volume volume-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1 (1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1): created successfully
Jun 26 05:44:32 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb519796-36f4-49f2-ac53-2e3a45274d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:32 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Flow 'volume_create_manager' (c2efbbda-f4c2-41f0-8edc-661bde8e8ea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:44:32 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-3101df26-db2a-495d-acc7-a68d717d7323 tempest-DeleteServersTestJSON-990107107 None] Created volume successfully.
Jun 26 05:44:33 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b548be34-cd81-4a02-9333-658529ff25d3 tempest-VolumesTransfersV355Test-1178559414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-52f766ca-e480-42f5-9be6-9c407aefaf4c" returned: 0 in 0.946s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b548be34-cd81-4a02-9333-658529ff25d3 tempest-VolumesTransfersV355Test-1178559414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-52f766ca-e480-42f5-9be6-9c407aefaf4c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:33 devstack sudo[97193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-52f766ca-e480-42f5-9be6-9c407aefaf4c
Jun 26 05:44:33 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:34 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b548be34-cd81-4a02-9333-658529ff25d3 tempest-VolumesTransfersV355Test-1178559414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-52f766ca-e480-42f5-9be6-9c407aefaf4c" returned: 0 in 0.964s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-b548be34-cd81-4a02-9333-658529ff25d3 tempest-VolumesTransfersV355Test-1178559414 None] Lock "cinder-quobyte-52f766ca-e480-42f5-9be6-9c407aefaf4c" released by "delete_volume" :: held 1.978s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:44:34 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-b548be34-cd81-4a02-9333-658529ff25d3 tempest-VolumesTransfersV355Test-1178559414 None] Created reservations ['8afdde98-c088-4bd0-9351-51d757b6e522', '04c9a3d8-7a6d-4551-aaf8-e3784797071d', '140dbd84-791c-4922-8f00-6202f5e1e632', 'd333809d-6fd6-4510-8d7e-17adadfeff91'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:44:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9321b808-c2de-44ce-beef-6f6963c1d1b1 tempest-ServerActionsTestOtherA-2094131569 None] Acquiring lock "cinder-63ec2b25-b2b9-4e93-8640-da6104b7a633-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:44:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b548be34-cd81-4a02-9333-658529ff25d3 tempest-VolumesTransfersV355Test-1178559414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:44:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b548be34-cd81-4a02-9333-658529ff25d3 tempest-VolumesTransfersV355Test-1178559414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:44:34 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b548be34-cd81-4a02-9333-658529ff25d3 tempest-VolumesTransfersV355Test-1178559414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:44:34 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b548be34-cd81-4a02-9333-658529ff25d3 tempest-VolumesTransfersV355Test-1178559414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:44:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b548be34-cd81-4a02-9333-658529ff25d3 tempest-VolumesTransfersV355Test-1178559414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b548be34-cd81-4a02-9333-658529ff25d3 tempest-VolumesTransfersV355Test-1178559414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9321b808-c2de-44ce-beef-6f6963c1d1b1 tempest-ServerActionsTestOtherA-2094131569 None] Lock "cinder-63ec2b25-b2b9-4e93-8640-da6104b7a633-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:44:34 devstack sudo[97201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:44:34 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9321b808-c2de-44ce-beef-6f6963c1d1b1 tempest-ServerActionsTestOtherA-2094131569 None] Acquiring lock "cinder-quobyte-63ec2b25-b2b9-4e93-8640-da6104b7a633" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:44:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9321b808-c2de-44ce-beef-6f6963c1d1b1 tempest-ServerActionsTestOtherA-2094131569 None] Lock "cinder-quobyte-63ec2b25-b2b9-4e93-8640-da6104b7a633" acquired by "delete_volume" :: waited 0.022s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:44:34 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7e5bfb-5b29-4477-ac27-c2918600d474]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:44:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9321b808-c2de-44ce-beef-6f6963c1d1b1 tempest-ServerActionsTestOtherA-2094131569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63ec2b25-b2b9-4e93-8640-da6104b7a633 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:34 devstack sudo[97203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63ec2b25-b2b9-4e93-8640-da6104b7a633
Jun 26 05:44:34 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:35 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Flow 'volume_create_manager' (03e8b0e1-ef71-4612-bad8-31bc805da580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e28dec4-bfa0-4fcb-b205-d1af0ddbd66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:36 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9321b808-c2de-44ce-beef-6f6963c1d1b1 tempest-ServerActionsTestOtherA-2094131569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63ec2b25-b2b9-4e93-8640-da6104b7a633" returned: 0 in 1.432s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9321b808-c2de-44ce-beef-6f6963c1d1b1 tempest-ServerActionsTestOtherA-2094131569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63ec2b25-b2b9-4e93-8640-da6104b7a633 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:36 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e28dec4-bfa0-4fcb-b205-d1af0ddbd66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1793152222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88b7603-b518-4059-b55a-07a4eb41cbf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70858d5f35be4266afffb27d95b4127d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:44:36Z,use_quota=True,user_id='d92953dc2c0c40e5add38b7a784b0e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:36 devstack sudo[97209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63ec2b25-b2b9-4e93-8640-da6104b7a633
Jun 26 05:44:36 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b277b36-e27e-4c1d-b1b5-34f682042028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b277b36-e27e-4c1d-b1b5-34f682042028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5d0148-aed7-4c91-b405-8a40ad161fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5d0148-aed7-4c91-b405-8a40ad161fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b88b7603-b518-4059-b55a-07a4eb41cbf2', 'volume_name': 'volume-b88b7603-b518-4059-b55a-07a4eb41cbf2', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1d6e28-33a9-4c85-bca0-cd7199b28824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1d6e28-33a9-4c85-bca0-cd7199b28824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31656a38-dd06-4781-835f-53cf01dd1f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:36 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Volume b88b7603-b518-4059-b55a-07a4eb41cbf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b88b7603-b518-4059-b55a-07a4eb41cbf2', 'volume_size': 1}
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1793152222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88b7603-b518-4059-b55a-07a4eb41cbf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70858d5f35be4266afffb27d95b4127d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:44:36Z,use_quota=True,user_id='d92953dc2c0c40e5add38b7a784b0e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Creating volume b88b7603-b518-4059-b55a-07a4eb41cbf2 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:44:36 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b88b7603-b518-4059-b55a-07a4eb41cbf2 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b548be34-cd81-4a02-9333-658529ff25d3 tempest-VolumesTransfersV355Test-1178559414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.777s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-b548be34-cd81-4a02-9333-658529ff25d3 tempest-VolumesTransfersV355Test-1178559414 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:44:36 devstack sudo[97212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b88b7603-b518-4059-b55a-07a4eb41cbf2 1073741824
Jun 26 05:44:36 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:36 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-b548be34-cd81-4a02-9333-658529ff25d3 tempest-VolumesTransfersV355Test-1178559414 None] Deleted volume successfully.
Jun 26 05:44:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-b548be34-cd81-4a02-9333-658529ff25d3 tempest-VolumesTransfersV355Test-1178559414 None] Lock "cinder-52f766ca-e480-42f5-9be6-9c407aefaf4c-delete_volume" released by "delete_volume" :: held 4.207s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:44:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-9e1fba5d-6826-4d6e-ac32-ff6939141294 req-708d20f3-9d5e-4e19-abbd-ad966fe52077 tempest-DeleteServersTestJSON-990107107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:44:37 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9321b808-c2de-44ce-beef-6f6963c1d1b1 tempest-ServerActionsTestOtherA-2094131569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63ec2b25-b2b9-4e93-8640-da6104b7a633" returned: 0 in 1.163s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9321b808-c2de-44ce-beef-6f6963c1d1b1 tempest-ServerActionsTestOtherA-2094131569 None] Lock "cinder-quobyte-63ec2b25-b2b9-4e93-8640-da6104b7a633" released by "delete_volume" :: held 2.667s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:44:37 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-9321b808-c2de-44ce-beef-6f6963c1d1b1 tempest-ServerActionsTestOtherA-2094131569 None] Created reservations ['79a783f2-5c32-4f91-ad7e-6ca9add6cdc2', 'ccaa8db2-80f0-4695-9e52-655ab755623c', '168f46d3-e286-4836-9613-7fe879d87737', 'c8ec81da-26f1-4f61-bf5c-42bc9da997ab'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:44:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9321b808-c2de-44ce-beef-6f6963c1d1b1 tempest-ServerActionsTestOtherA-2094131569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:44:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9321b808-c2de-44ce-beef-6f6963c1d1b1 tempest-ServerActionsTestOtherA-2094131569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:44:37 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9321b808-c2de-44ce-beef-6f6963c1d1b1 tempest-ServerActionsTestOtherA-2094131569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:44:37 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9321b808-c2de-44ce-beef-6f6963c1d1b1 tempest-ServerActionsTestOtherA-2094131569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:44:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9321b808-c2de-44ce-beef-6f6963c1d1b1 tempest-ServerActionsTestOtherA-2094131569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9321b808-c2de-44ce-beef-6f6963c1d1b1 tempest-ServerActionsTestOtherA-2094131569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:37 devstack sudo[97226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:44:37 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:37 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b88b7603-b518-4059-b55a-07a4eb41cbf2 1073741824" returned: 0 in 1.561s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b88b7603-b518-4059-b55a-07a4eb41cbf2 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:37 devstack sudo[97234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b88b7603-b518-4059-b55a-07a4eb41cbf2
Jun 26 05:44:37 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:38 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9321b808-c2de-44ce-beef-6f6963c1d1b1 tempest-ServerActionsTestOtherA-2094131569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.093s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:38 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-9321b808-c2de-44ce-beef-6f6963c1d1b1 tempest-ServerActionsTestOtherA-2094131569 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:44:38 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-9321b808-c2de-44ce-beef-6f6963c1d1b1 tempest-ServerActionsTestOtherA-2094131569 None] Deleted volume successfully.
Jun 26 05:44:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9321b808-c2de-44ce-beef-6f6963c1d1b1 tempest-ServerActionsTestOtherA-2094131569 None] Lock "cinder-63ec2b25-b2b9-4e93-8640-da6104b7a633-delete_volume" released by "delete_volume" :: held 4.059s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:44:38 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b88b7603-b518-4059-b55a-07a4eb41cbf2" returned: 0 in 1.139s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:38 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] <== create_volume: return (2807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:44:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.813s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-9e1fba5d-6826-4d6e-ac32-ff6939141294 req-708d20f3-9d5e-4e19-abbd-ad966fe52077 tempest-DeleteServersTestJSON-990107107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.818s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:44:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31656a38-dd06-4781-835f-53cf01dd1f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b88b7603-b518-4059-b55a-07a4eb41cbf2', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5641a0a-139b-4f69-9d7d-f1cd27fe35b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:39 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9dc1f5-be48-4940-abe8-922b7b015b28]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:44:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-9e1fba5d-6826-4d6e-ac32-ff6939141294 req-708d20f3-9d5e-4e19-abbd-ad966fe52077 tempest-DeleteServersTestJSON-990107107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:39 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Volume volume-b88b7603-b518-4059-b55a-07a4eb41cbf2 (b88b7603-b518-4059-b55a-07a4eb41cbf2): created successfully
Jun 26 05:44:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5641a0a-139b-4f69-9d7d-f1cd27fe35b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Flow 'volume_create_manager' (03e8b0e1-ef71-4612-bad8-31bc805da580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:44:39 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-4b1c54d6-8567-4822-a7bf-52a5c7f38f35 tempest-VolumesTransfersV355Test-1225711916 None] Created volume successfully.
Jun 26 05:44:39 devstack sudo[97281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1
Jun 26 05:44:39 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:40 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-9e1fba5d-6826-4d6e-ac32-ff6939141294 req-708d20f3-9d5e-4e19-abbd-ad966fe52077 tempest-DeleteServersTestJSON-990107107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1" returned: 0 in 1.222s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-9e1fba5d-6826-4d6e-ac32-ff6939141294 req-708d20f3-9d5e-4e19-abbd-ad966fe52077 tempest-DeleteServersTestJSON-990107107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.269s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:40 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-9e1fba5d-6826-4d6e-ac32-ff6939141294 req-708d20f3-9d5e-4e19-abbd-ad966fe52077 tempest-DeleteServersTestJSON-990107107 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85', 'name': 'volume-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '937d71fe-6ac7-48e7-beae-1b7eb3d9c9f5', 'enforce_multipath': True} {{(pid=93708) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 05:44:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-b5c0a2e6-bcc5-4fa2-93e1-22de8f5e7822 tempest-VolumesTransfersV355Test-1178559414 None] Acquiring lock "cinder-b88b7603-b518-4059-b55a-07a4eb41cbf2-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:44:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-b5c0a2e6-bcc5-4fa2-93e1-22de8f5e7822 tempest-VolumesTransfersV355Test-1178559414 None] Lock "cinder-b88b7603-b518-4059-b55a-07a4eb41cbf2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:44:40 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-9e1fba5d-6826-4d6e-ac32-ff6939141294 req-708d20f3-9d5e-4e19-abbd-ad966fe52077 tempest-DeleteServersTestJSON-990107107 None] attachment_update completed successfully.
Jun 26 05:44:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-b5c0a2e6-bcc5-4fa2-93e1-22de8f5e7822 tempest-VolumesTransfersV355Test-1178559414 None] Acquiring lock "cinder-quobyte-b88b7603-b518-4059-b55a-07a4eb41cbf2" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:44:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-b5c0a2e6-bcc5-4fa2-93e1-22de8f5e7822 tempest-VolumesTransfersV355Test-1178559414 None] Lock "cinder-quobyte-b88b7603-b518-4059-b55a-07a4eb41cbf2" acquired by "delete_volume" :: waited 0.017s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:44:40 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[929480d8-6191-480f-9522-af7b371db5b0]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:44:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b5c0a2e6-bcc5-4fa2-93e1-22de8f5e7822 tempest-VolumesTransfersV355Test-1178559414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b88b7603-b518-4059-b55a-07a4eb41cbf2 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:40 devstack sudo[97344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b88b7603-b518-4059-b55a-07a4eb41cbf2
Jun 26 05:44:40 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:41 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b5c0a2e6-bcc5-4fa2-93e1-22de8f5e7822 tempest-VolumesTransfersV355Test-1178559414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b88b7603-b518-4059-b55a-07a4eb41cbf2" returned: 0 in 0.930s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b5c0a2e6-bcc5-4fa2-93e1-22de8f5e7822 tempest-VolumesTransfersV355Test-1178559414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b88b7603-b518-4059-b55a-07a4eb41cbf2 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:41 devstack sudo[97417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b88b7603-b518-4059-b55a-07a4eb41cbf2
Jun 26 05:44:41 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:42 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b5c0a2e6-bcc5-4fa2-93e1-22de8f5e7822 tempest-VolumesTransfersV355Test-1178559414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b88b7603-b518-4059-b55a-07a4eb41cbf2" returned: 0 in 0.902s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-b5c0a2e6-bcc5-4fa2-93e1-22de8f5e7822 tempest-VolumesTransfersV355Test-1178559414 None] Lock "cinder-quobyte-b88b7603-b518-4059-b55a-07a4eb41cbf2" released by "delete_volume" :: held 1.883s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:44:42 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-b5c0a2e6-bcc5-4fa2-93e1-22de8f5e7822 tempest-VolumesTransfersV355Test-1178559414 None] Created reservations ['3c566674-3401-472a-a397-43d28dfb8c33', '685c2a99-55b4-40f7-8024-f2aa953a0597', '31224f62-43d3-45a8-86ff-ffa66ad2aba9', '87316f49-9e3c-4ca7-9996-da4a12c1bcd7'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:44:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b5c0a2e6-bcc5-4fa2-93e1-22de8f5e7822 tempest-VolumesTransfersV355Test-1178559414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:44:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b5c0a2e6-bcc5-4fa2-93e1-22de8f5e7822 tempest-VolumesTransfersV355Test-1178559414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:44:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b5c0a2e6-bcc5-4fa2-93e1-22de8f5e7822 tempest-VolumesTransfersV355Test-1178559414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:44:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b5c0a2e6-bcc5-4fa2-93e1-22de8f5e7822 tempest-VolumesTransfersV355Test-1178559414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:44:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b5c0a2e6-bcc5-4fa2-93e1-22de8f5e7822 tempest-VolumesTransfersV355Test-1178559414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b5c0a2e6-bcc5-4fa2-93e1-22de8f5e7822 tempest-VolumesTransfersV355Test-1178559414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:42 devstack sudo[97742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:44:42 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:43 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b5c0a2e6-bcc5-4fa2-93e1-22de8f5e7822 tempest-VolumesTransfersV355Test-1178559414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.698s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:43 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-b5c0a2e6-bcc5-4fa2-93e1-22de8f5e7822 tempest-VolumesTransfersV355Test-1178559414 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:44:43 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-b5c0a2e6-bcc5-4fa2-93e1-22de8f5e7822 tempest-VolumesTransfersV355Test-1178559414 None] Deleted volume successfully.
Jun 26 05:44:43 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-b5c0a2e6-bcc5-4fa2-93e1-22de8f5e7822 tempest-VolumesTransfersV355Test-1178559414 None] Lock "cinder-b88b7603-b518-4059-b55a-07a4eb41cbf2-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:44:51 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=55,cinder:UPDATE=73,cinder:INSERT=17,cinder:DELETE=6 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:44:51 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-5cdc13dc-7e1f-4be3-9e6c-48940300ce94 req-98188952-4103-4549-8a3e-b7000ee072df tempest-DeleteServersTestJSON-990107107 None] Terminate volume connection completed successfully.
Jun 26 05:44:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-5cdc13dc-7e1f-4be3-9e6c-48940300ce94 req-98188952-4103-4549-8a3e-b7000ee072df tempest-DeleteServersTestJSON-990107107 None] Deleting attachment 937d71fe-6ac7-48e7-beae-1b7eb3d9c9f5. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Flow 'volume_create_manager' (516ee6bd-2ba7-47b9-8eea-befbf03e4f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533f8487-3388-403e-a970-f323adc65e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533f8487-3388-403e-a970-f323adc65e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1349566032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f80226d-a541-4c4e-801d-82e07dca10ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60dbdf4e57be403d9dcc7422827a7fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:44:53Z,use_quota=True,user_id='d661e2efa7c241dd97b4b9139035038d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9044b6-de2d-4436-8390-8c7b8dfc9ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9044b6-de2d-4436-8390-8c7b8dfc9ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (067e538e-9fa2-4e93-b921-ab76bf48412f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (067e538e-9fa2-4e93-b921-ab76bf48412f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f80226d-a541-4c4e-801d-82e07dca10ab', 'volume_name': 'volume-2f80226d-a541-4c4e-801d-82e07dca10ab', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f31f4c-0b37-4e67-af21-d38115673971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f31f4c-0b37-4e67-af21-d38115673971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fac5338-d123-4b4b-b311-a4d80dff8855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:53 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Volume 2f80226d-a541-4c4e-801d-82e07dca10ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f80226d-a541-4c4e-801d-82e07dca10ab', 'volume_size': 1}
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1349566032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f80226d-a541-4c4e-801d-82e07dca10ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60dbdf4e57be403d9dcc7422827a7fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:44:53Z,use_quota=True,user_id='d661e2efa7c241dd97b4b9139035038d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Creating volume 2f80226d-a541-4c4e-801d-82e07dca10ab {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:44:53 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:44:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2f80226d-a541-4c4e-801d-82e07dca10ab 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:53 devstack sudo[97903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2f80226d-a541-4c4e-801d-82e07dca10ab 1073741824
Jun 26 05:44:53 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:54 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2f80226d-a541-4c4e-801d-82e07dca10ab 1073741824" returned: 0 in 1.020s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2f80226d-a541-4c4e-801d-82e07dca10ab {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:54 devstack sudo[97910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2f80226d-a541-4c4e-801d-82e07dca10ab
Jun 26 05:44:54 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:54 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=57,cinder:INSERT=15,cinder:UPDATE=68,cinder:DELETE=6 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:44:55 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2f80226d-a541-4c4e-801d-82e07dca10ab" returned: 0 in 0.794s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:55 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:44:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:55 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fac5338-d123-4b4b-b311-a4d80dff8855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f80226d-a541-4c4e-801d-82e07dca10ab', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:55 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23bed76e-f275-4746-991e-aa1acf4380cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:44:55 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Volume volume-2f80226d-a541-4c4e-801d-82e07dca10ab (2f80226d-a541-4c4e-801d-82e07dca10ab): created successfully
Jun 26 05:44:55 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23bed76e-f275-4746-991e-aa1acf4380cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:44:55 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Flow 'volume_create_manager' (516ee6bd-2ba7-47b9-8eea-befbf03e4f38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:44:55 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-56d7b67d-461a-4cc4-b90a-719fb543befd tempest-VolumesTransfersV357Test-2123376861 None] Created volume successfully.
Jun 26 05:44:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4b3b7b56-7e09-41eb-8535-a8c90166b02e tempest-DeleteServersTestJSON-990107107 None] Acquiring lock "cinder-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:44:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4b3b7b56-7e09-41eb-8535-a8c90166b02e tempest-DeleteServersTestJSON-990107107 None] Lock "cinder-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:44:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4b3b7b56-7e09-41eb-8535-a8c90166b02e tempest-DeleteServersTestJSON-990107107 None] Acquiring lock "cinder-quobyte-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:44:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4b3b7b56-7e09-41eb-8535-a8c90166b02e tempest-DeleteServersTestJSON-990107107 None] Lock "cinder-quobyte-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1" acquired by "delete_volume" :: waited 0.027s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:44:55 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d232ad-bb8e-4449-9b5c-dfb6056350b8]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:44:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4b3b7b56-7e09-41eb-8535-a8c90166b02e tempest-DeleteServersTestJSON-990107107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:55 devstack sudo[97913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1
Jun 26 05:44:55 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:56 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4b3b7b56-7e09-41eb-8535-a8c90166b02e tempest-DeleteServersTestJSON-990107107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1" returned: 0 in 1.010s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4b3b7b56-7e09-41eb-8535-a8c90166b02e tempest-DeleteServersTestJSON-990107107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:56 devstack sudo[97919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1
Jun 26 05:44:56 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:57 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-291b0ad7-6871-43bc-b825-72040553b789 tempest-VolumesTransfersV357Test-1496812994 None] Transfer volume completed successfully.
Jun 26 05:44:57 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4b3b7b56-7e09-41eb-8535-a8c90166b02e tempest-DeleteServersTestJSON-990107107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1" returned: 0 in 1.040s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4b3b7b56-7e09-41eb-8535-a8c90166b02e tempest-DeleteServersTestJSON-990107107 None] Lock "cinder-quobyte-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1" released by "delete_volume" :: held 2.105s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:44:57 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-4b3b7b56-7e09-41eb-8535-a8c90166b02e tempest-DeleteServersTestJSON-990107107 None] Created reservations ['572e3f30-b841-4838-a9f1-82105c356fcc', 'ed2d7f68-b8ac-4a07-8579-6450457044a1', '42feb41e-76ce-4a4b-862d-4ca362e326b9', '2ddb0396-0472-4c36-b178-8fa622df746a'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:44:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4b3b7b56-7e09-41eb-8535-a8c90166b02e tempest-DeleteServersTestJSON-990107107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:44:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4b3b7b56-7e09-41eb-8535-a8c90166b02e tempest-DeleteServersTestJSON-990107107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:44:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4b3b7b56-7e09-41eb-8535-a8c90166b02e tempest-DeleteServersTestJSON-990107107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:44:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4b3b7b56-7e09-41eb-8535-a8c90166b02e tempest-DeleteServersTestJSON-990107107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:44:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4b3b7b56-7e09-41eb-8535-a8c90166b02e tempest-DeleteServersTestJSON-990107107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:44:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4b3b7b56-7e09-41eb-8535-a8c90166b02e tempest-DeleteServersTestJSON-990107107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:58 devstack sudo[97931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:44:58 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:44:58 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dcbd496d-cb63-45e2-bd88-8165d40085e7 tempest-VolumesTransfersV357Test-1169194186 None] Acquiring lock "cinder-2f80226d-a541-4c4e-801d-82e07dca10ab-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:44:58 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dcbd496d-cb63-45e2-bd88-8165d40085e7 tempest-VolumesTransfersV357Test-1169194186 None] Lock "cinder-2f80226d-a541-4c4e-801d-82e07dca10ab-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:44:59 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dcbd496d-cb63-45e2-bd88-8165d40085e7 tempest-VolumesTransfersV357Test-1169194186 None] Acquiring lock "cinder-quobyte-2f80226d-a541-4c4e-801d-82e07dca10ab" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:44:59 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dcbd496d-cb63-45e2-bd88-8165d40085e7 tempest-VolumesTransfersV357Test-1169194186 None] Lock "cinder-quobyte-2f80226d-a541-4c4e-801d-82e07dca10ab" acquired by "delete_volume" :: waited 0.031s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:44:59 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root
Jun 26 05:44:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4b3b7b56-7e09-41eb-8535-a8c90166b02e tempest-DeleteServersTestJSON-990107107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.959s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:44:59 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-4b3b7b56-7e09-41eb-8535-a8c90166b02e tempest-DeleteServersTestJSON-990107107 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:44:59 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cac8fb1-fcd2-425a-a8ee-1f45c6185db6]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:44:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dcbd496d-cb63-45e2-bd88-8165d40085e7 tempest-VolumesTransfersV357Test-1169194186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2f80226d-a541-4c4e-801d-82e07dca10ab {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:44:59 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-4b3b7b56-7e09-41eb-8535-a8c90166b02e tempest-DeleteServersTestJSON-990107107 None] Deleted volume successfully.
Jun 26 05:44:59 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4b3b7b56-7e09-41eb-8535-a8c90166b02e tempest-DeleteServersTestJSON-990107107 None] Lock "cinder-1ebf15ed-cbbd-4ddb-86d8-5f0997c0b3c1-delete_volume" released by "delete_volume" :: held 3.595s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:44:59 devstack sudo[97940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2f80226d-a541-4c4e-801d-82e07dca10ab
Jun 26 05:44:59 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:00 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dcbd496d-cb63-45e2-bd88-8165d40085e7 tempest-VolumesTransfersV357Test-1169194186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2f80226d-a541-4c4e-801d-82e07dca10ab" returned: 0 in 1.065s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dcbd496d-cb63-45e2-bd88-8165d40085e7 tempest-VolumesTransfersV357Test-1169194186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2f80226d-a541-4c4e-801d-82e07dca10ab {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:00 devstack sudo[97960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2f80226d-a541-4c4e-801d-82e07dca10ab
Jun 26 05:45:00 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:00 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dcbd496d-cb63-45e2-bd88-8165d40085e7 tempest-VolumesTransfersV357Test-1169194186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2f80226d-a541-4c4e-801d-82e07dca10ab" returned: 0 in 0.745s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:00 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dcbd496d-cb63-45e2-bd88-8165d40085e7 tempest-VolumesTransfersV357Test-1169194186 None] Lock "cinder-quobyte-2f80226d-a541-4c4e-801d-82e07dca10ab" released by "delete_volume" :: held 1.885s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-dcbd496d-cb63-45e2-bd88-8165d40085e7 tempest-VolumesTransfersV357Test-1169194186 None] Created reservations ['4d51e1d9-097c-4c96-a8a3-fff26184aff4', 'da591da3-66bc-4474-a83e-5e0953c4bab4', '4ea09e08-127a-4b46-87c5-6478a39405eb', '519c52fc-bc97-4fd9-b2e2-c333c994ad02'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dcbd496d-cb63-45e2-bd88-8165d40085e7 tempest-VolumesTransfersV357Test-1169194186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dcbd496d-cb63-45e2-bd88-8165d40085e7 tempest-VolumesTransfersV357Test-1169194186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dcbd496d-cb63-45e2-bd88-8165d40085e7 tempest-VolumesTransfersV357Test-1169194186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dcbd496d-cb63-45e2-bd88-8165d40085e7 tempest-VolumesTransfersV357Test-1169194186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dcbd496d-cb63-45e2-bd88-8165d40085e7 tempest-VolumesTransfersV357Test-1169194186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dcbd496d-cb63-45e2-bd88-8165d40085e7 tempest-VolumesTransfersV357Test-1169194186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:01 devstack sudo[97964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:45:01 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Flow 'volume_create_manager' (cc622c35-3ee0-49f5-a2f0-362f52b3151c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243fdf10-43c3-4023-9c1d-2404eecd546e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243fdf10-43c3-4023-9c1d-2404eecd546e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-281511809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60dbdf4e57be403d9dcc7422827a7fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:45:02Z,use_quota=True,user_id='d661e2efa7c241dd97b4b9139035038d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e04689f-3c34-4083-9e1f-46dd41935989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e04689f-3c34-4083-9e1f-46dd41935989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3496aaaf-e951-43ce-b892-b30dc3c3d188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3496aaaf-e951-43ce-b892-b30dc3c3d188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea', 'volume_name': 'volume-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ab5a47-acd4-491e-8b8f-574e3a766965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ab5a47-acd4-491e-8b8f-574e3a766965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0a9218-26f5-49da-a37b-679873a041c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:01 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Volume c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea', 'volume_size': 1}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-281511809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60dbdf4e57be403d9dcc7422827a7fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:45:02Z,use_quota=True,user_id='d661e2efa7c241dd97b4b9139035038d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Creating volume c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:45:01 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:45:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:01 devstack sudo[97970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea 1073741824
Jun 26 05:45:01 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:02 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dcbd496d-cb63-45e2-bd88-8165d40085e7 tempest-VolumesTransfersV357Test-1169194186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.864s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:02 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-dcbd496d-cb63-45e2-bd88-8165d40085e7 tempest-VolumesTransfersV357Test-1169194186 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:45:02 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-dcbd496d-cb63-45e2-bd88-8165d40085e7 tempest-VolumesTransfersV357Test-1169194186 None] Deleted volume successfully.
Jun 26 05:45:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dcbd496d-cb63-45e2-bd88-8165d40085e7 tempest-VolumesTransfersV357Test-1169194186 None] Lock "cinder-2f80226d-a541-4c4e-801d-82e07dca10ab-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:45:03 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea 1073741824" returned: 0 in 1.192s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:03 devstack sudo[97978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea
Jun 26 05:45:03 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:03 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea" returned: 0 in 0.690s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:03 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:45:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:45:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0a9218-26f5-49da-a37b-679873a041c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b02730b-fa10-4263-8fc2-a6d839166ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:03 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Volume volume-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea (c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea): created successfully
Jun 26 05:45:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b02730b-fa10-4263-8fc2-a6d839166ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Flow 'volume_create_manager' (cc622c35-3ee0-49f5-a2f0-362f52b3151c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:45:03 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-fff90ca6-0866-4ea1-a537-882caa8df24e tempest-VolumesTransfersV357Test-2123376861 None] Created volume successfully.
Jun 26 05:45:05 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-b1361dfb-1736-4477-a564-cd74cf61bc70 tempest-VolumesTransfersV357Test-1169194186 None] Acquiring lock "cinder-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:45:05 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-b1361dfb-1736-4477-a564-cd74cf61bc70 tempest-VolumesTransfersV357Test-1169194186 None] Lock "cinder-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:45:05 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-b1361dfb-1736-4477-a564-cd74cf61bc70 tempest-VolumesTransfersV357Test-1169194186 None] Acquiring lock "cinder-quobyte-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:45:05 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-b1361dfb-1736-4477-a564-cd74cf61bc70 tempest-VolumesTransfersV357Test-1169194186 None] Lock "cinder-quobyte-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea" acquired by "delete_volume" :: waited 0.026s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:45:05 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd08fdd-4596-4a26-9932-ffb1ec660e3e]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:45:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b1361dfb-1736-4477-a564-cd74cf61bc70 tempest-VolumesTransfersV357Test-1169194186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:05 devstack sudo[97985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea
Jun 26 05:45:05 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:06 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b1361dfb-1736-4477-a564-cd74cf61bc70 tempest-VolumesTransfersV357Test-1169194186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea" returned: 0 in 1.024s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b1361dfb-1736-4477-a564-cd74cf61bc70 tempest-VolumesTransfersV357Test-1169194186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:06 devstack sudo[97990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea
Jun 26 05:45:06 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:07 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b1361dfb-1736-4477-a564-cd74cf61bc70 tempest-VolumesTransfersV357Test-1169194186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea" returned: 0 in 1.158s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:07 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-b1361dfb-1736-4477-a564-cd74cf61bc70 tempest-VolumesTransfersV357Test-1169194186 None] Lock "cinder-quobyte-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea" released by "delete_volume" :: held 2.268s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:45:07 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-b1361dfb-1736-4477-a564-cd74cf61bc70 tempest-VolumesTransfersV357Test-1169194186 None] Created reservations ['b609de58-a97f-4bc0-88ee-689bc2ef3c30', '683f5e16-59f9-4a4d-9219-e25901a72860', '507ff229-20c4-44ff-8513-74d7d4a9c842', 'd4ac70bb-2da2-40b0-a16e-dd19f4171c03'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:45:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b1361dfb-1736-4477-a564-cd74cf61bc70 tempest-VolumesTransfersV357Test-1169194186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:45:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b1361dfb-1736-4477-a564-cd74cf61bc70 tempest-VolumesTransfersV357Test-1169194186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:45:08 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b1361dfb-1736-4477-a564-cd74cf61bc70 tempest-VolumesTransfersV357Test-1169194186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:45:08 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b1361dfb-1736-4477-a564-cd74cf61bc70 tempest-VolumesTransfersV357Test-1169194186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:45:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b1361dfb-1736-4477-a564-cd74cf61bc70 tempest-VolumesTransfersV357Test-1169194186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:45:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b1361dfb-1736-4477-a564-cd74cf61bc70 tempest-VolumesTransfersV357Test-1169194186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:08 devstack sudo[97993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:45:08 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:08 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b1361dfb-1736-4477-a564-cd74cf61bc70 tempest-VolumesTransfersV357Test-1169194186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.731s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:08 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-b1361dfb-1736-4477-a564-cd74cf61bc70 tempest-VolumesTransfersV357Test-1169194186 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:45:08 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-b1361dfb-1736-4477-a564-cd74cf61bc70 tempest-VolumesTransfersV357Test-1169194186 None] Deleted volume successfully.
Jun 26 05:45:08 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-b1361dfb-1736-4477-a564-cd74cf61bc70 tempest-VolumesTransfersV357Test-1169194186 None] Lock "cinder-c4ee7d9e-fb4c-4d3d-8599-5fc420f16fea-delete_volume" released by "delete_volume" :: held 3.329s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:45:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:45:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:45:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:45:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:45:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:45:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:45:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:10 devstack sudo[98004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:45:10 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:11 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.908s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:11 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Flow 'volume_create_manager' (8e52d57a-f309-47e5-80cd-09f32905cf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b3a8a9-a416-472f-85ad-3c9711bf22e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b3a8a9-a416-472f-85ad-3c9711bf22e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1338504623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b62d44-6f88-4df7-91fd-8000e5eb945c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0314520e10284e25b1a01e72cc70f5e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:45:16Z,use_quota=True,user_id='6de6f0d5d9cb47e9888ee7d59527cae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e740ed-4de2-4228-bab5-ffb141e5d721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e740ed-4de2-4228-bab5-ffb141e5d721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b0185f-0392-48ed-8cda-c6280cc1c89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b0185f-0392-48ed-8cda-c6280cc1c89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8b62d44-6f88-4df7-91fd-8000e5eb945c', 'volume_name': 'volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1415b1-389a-4237-8033-9c75f7646350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1415b1-389a-4237-8033-9c75f7646350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d8042a-68ff-4b5a-9eff-c698a23c8d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:16 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Volume a8b62d44-6f88-4df7-91fd-8000e5eb945c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c', 'volume_size': 1}
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1338504623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b62d44-6f88-4df7-91fd-8000e5eb945c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0314520e10284e25b1a01e72cc70f5e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:45:16Z,use_quota=True,user_id='6de6f0d5d9cb47e9888ee7d59527cae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Creating volume a8b62d44-6f88-4df7-91fd-8000e5eb945c {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:45:16 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:45:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:16 devstack sudo[98100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c 1073741824
Jun 26 05:45:16 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:17 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c 1073741824" returned: 0 in 1.262s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:18 devstack sudo[98124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c
Jun 26 05:45:18 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:18 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c" returned: 0 in 0.705s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] <== create_volume: return (2053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:45:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:45:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d8042a-68ff-4b5a-9eff-c698a23c8d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f029a887-f826-491d-877e-8c2e25d22609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:18 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Volume volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c (a8b62d44-6f88-4df7-91fd-8000e5eb945c): created successfully
Jun 26 05:45:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f029a887-f826-491d-877e-8c2e25d22609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Flow 'volume_create_manager' (8e52d57a-f309-47e5-80cd-09f32905cf3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:45:18 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-7c0aba4f-e0f2-47c9-8e15-1ea5df7c1374 tempest-VolumesCloneTest-2072327378 None] Created volume successfully.
Jun 26 05:45:20 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:45:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Flow 'volume_create_manager' (c3795bc4-c5bb-461d-83c0-9b1474fc72c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:45:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c4c980-1029-4cde-a681-1c6cf8b9f898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c4c980-1029-4cde-a681-1c6cf8b9f898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1038375645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc595bf3-1429-48a2-b825-0c7ec24e10ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0314520e10284e25b1a01e72cc70f5e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:45:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=a8b62d44-6f88-4df7-91fd-8000e5eb945c,status='creating',terminated_at=None,updated_at=2026-06-26T03:45:21Z,use_quota=True,user_id='6de6f0d5d9cb47e9888ee7d59527cae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74182d06-c07c-442b-9d47-d39abc41e20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74182d06-c07c-442b-9d47-d39abc41e20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ee70f2-afc7-42c6-8ab7-31033d95af14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ee70f2-afc7-42c6-8ab7-31033d95af14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'dc595bf3-1429-48a2-b825-0c7ec24e10ce', 'volume_name': 'volume-dc595bf3-1429-48a2-b825-0c7ec24e10ce', 'volume_size': 2, 'source_volid': 'a8b62d44-6f88-4df7-91fd-8000e5eb945c', 'source_volstatus': 'available'}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6481b15e-358e-4ea3-b263-bc1f429891e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6481b15e-358e-4ea3-b263-bc1f429891e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62784c10-a385-487f-b649-93743c3fefe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:20 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Volume dc595bf3-1429-48a2-b825-0c7ec24e10ce: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-dc595bf3-1429-48a2-b825-0c7ec24e10ce', 'volume_size': 2, 'source_volid': 'a8b62d44-6f88-4df7-91fd-8000e5eb945c', 'source_volstatus': 'available'}
Jun 26 05:45:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:45:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:45:20 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Cloning volume a8b62d44-6f88-4df7-91fd-8000e5eb945c to volume dc595bf3-1429-48a2-b825-0c7ec24e10ce
Jun 26 05:45:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Creating offline snapshot 117249d7-9169-4fe7-be33-4a868da07a7a of volume a8b62d44-6f88-4df7-91fd-8000e5eb945c {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:45:21 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[7777a7a1-708b-478d-a6f7-34d44feb290d]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:45:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:21 devstack sudo[98146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c
Jun 26 05:45:21 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:22 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c" returned: 0 in 1.102s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:22 devstack sudo[98152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a 1G
Jun 26 05:45:22 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:23 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a 1G" returned: 0 in 1.013s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:23 devstack sudo[98158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a
Jun 26 05:45:23 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:23 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a" returned: 0 in 0.800s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:23 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a is being set with open permissions: ugo+rw
Jun 26 05:45:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:23 devstack sudo[98163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a
Jun 26 05:45:23 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:24 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a" returned: 0 in 0.703s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:24 devstack sudo[98166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.info
Jun 26 05:45:24 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:25 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.info" returned: 0 in 0.726s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:25 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.info is being set with open permissions: ugo+rw
Jun 26 05:45:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:25 devstack sudo[98171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.info
Jun 26 05:45:25 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:25 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ae8bb224-362c-4f12-a4fa-6aed36c0b541 tempest-AttachVolumeShelveTestJSON-1307149475 None] Acquiring lock "cinder-37e2f3cf-411a-4a40-abe2-ec59b567f3b4-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:45:25 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ae8bb224-362c-4f12-a4fa-6aed36c0b541 tempest-AttachVolumeShelveTestJSON-1307149475 None] Lock "cinder-37e2f3cf-411a-4a40-abe2-ec59b567f3b4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:45:25 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ae8bb224-362c-4f12-a4fa-6aed36c0b541 tempest-AttachVolumeShelveTestJSON-1307149475 None] Acquiring lock "cinder-quobyte-37e2f3cf-411a-4a40-abe2-ec59b567f3b4" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:45:25 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ae8bb224-362c-4f12-a4fa-6aed36c0b541 tempest-AttachVolumeShelveTestJSON-1307149475 None] Lock "cinder-quobyte-37e2f3cf-411a-4a40-abe2-ec59b567f3b4" acquired by "delete_volume" :: waited 0.030s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:45:25 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[c772070c-f8d3-4036-9c57-53416965502d]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:45:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ae8bb224-362c-4f12-a4fa-6aed36c0b541 tempest-AttachVolumeShelveTestJSON-1307149475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-37e2f3cf-411a-4a40-abe2-ec59b567f3b4 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:25 devstack sudo[98173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-37e2f3cf-411a-4a40-abe2-ec59b567f3b4
Jun 26 05:45:25 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:26 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.info" returned: 0 in 0.841s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:26 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Acquiring lock "cinder-quobyte-dc595bf3-1429-48a2-b825-0c7ec24e10ce" by "_copy_volume_from_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:45:26 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Lock "cinder-quobyte-dc595bf3-1429-48a2-b825-0c7ec24e10ce" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:45:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] snapshot: 117249d7-9169-4fe7-be33-4a868da07a7a, volume: dc595bf3-1429-48a2-b825-0c7ec24e10ce,  {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 05:45:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:45:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:45:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:45:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:45:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:45:26 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe28a2b-3c92-4a40-a1b0-9d0f242636b2]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:45:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:26 devstack sudo[98176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a
Jun 26 05:45:26 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:26 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ae8bb224-362c-4f12-a4fa-6aed36c0b541 tempest-AttachVolumeShelveTestJSON-1307149475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-37e2f3cf-411a-4a40-abe2-ec59b567f3b4" returned: 0 in 0.956s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ae8bb224-362c-4f12-a4fa-6aed36c0b541 tempest-AttachVolumeShelveTestJSON-1307149475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-37e2f3cf-411a-4a40-abe2-ec59b567f3b4 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:26 devstack sudo[98181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-37e2f3cf-411a-4a40-abe2-ec59b567f3b4
Jun 26 05:45:26 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a" returned: 0 in 1.044s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:45:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 05:45:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Creating direct copy from snapshot {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 05:45:27 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:27 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[523a906a-18ab-4210-843c-8deecf34c081]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:45:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:27 devstack sudo[98190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c
Jun 26 05:45:27 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:27 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ae8bb224-362c-4f12-a4fa-6aed36c0b541 tempest-AttachVolumeShelveTestJSON-1307149475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-37e2f3cf-411a-4a40-abe2-ec59b567f3b4" returned: 0 in 0.971s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ae8bb224-362c-4f12-a4fa-6aed36c0b541 tempest-AttachVolumeShelveTestJSON-1307149475 None] Lock "cinder-quobyte-37e2f3cf-411a-4a40-abe2-ec59b567f3b4" released by "delete_volume" :: held 1.983s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:45:27 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-ae8bb224-362c-4f12-a4fa-6aed36c0b541 tempest-AttachVolumeShelveTestJSON-1307149475 None] Created reservations ['4412b9e7-b405-48b6-b35d-99530122beee', 'ffffe9d4-fb14-4135-bf57-f464cfb8299d', 'e169adb7-b18c-4d5a-9af3-4d7f5faac87d', '43654c07-0ee5-4170-b40b-67afcf7582bb'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:45:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ae8bb224-362c-4f12-a4fa-6aed36c0b541 tempest-AttachVolumeShelveTestJSON-1307149475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:45:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ae8bb224-362c-4f12-a4fa-6aed36c0b541 tempest-AttachVolumeShelveTestJSON-1307149475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:45:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ae8bb224-362c-4f12-a4fa-6aed36c0b541 tempest-AttachVolumeShelveTestJSON-1307149475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:45:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ae8bb224-362c-4f12-a4fa-6aed36c0b541 tempest-AttachVolumeShelveTestJSON-1307149475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:45:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ae8bb224-362c-4f12-a4fa-6aed36c0b541 tempest-AttachVolumeShelveTestJSON-1307149475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:45:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ae8bb224-362c-4f12-a4fa-6aed36c0b541 tempest-AttachVolumeShelveTestJSON-1307149475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:27 devstack sudo[98194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:45:27 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:28 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c" returned: 0 in 1.071s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:28 devstack cinder-volume[93708]: DEBUG cinder.utils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Path /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc595bf3-1429-48a2-b825-0c7ec24e10ce not found in is_blk_device check {{(pid=93708) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 05:45:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc595bf3-1429-48a2-b825-0c7ec24e10ce {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:28 devstack sudo[98199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc595bf3-1429-48a2-b825-0c7ec24e10ce
Jun 26 05:45:28 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:29 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ae8bb224-362c-4f12-a4fa-6aed36c0b541 tempest-AttachVolumeShelveTestJSON-1307149475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.184s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:29 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-ae8bb224-362c-4f12-a4fa-6aed36c0b541 tempest-AttachVolumeShelveTestJSON-1307149475 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:45:29 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-ae8bb224-362c-4f12-a4fa-6aed36c0b541 tempest-AttachVolumeShelveTestJSON-1307149475 None] Deleted volume successfully.
Jun 26 05:45:29 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ae8bb224-362c-4f12-a4fa-6aed36c0b541 tempest-AttachVolumeShelveTestJSON-1307149475 None] Lock "cinder-37e2f3cf-411a-4a40-abe2-ec59b567f3b4-delete_volume" released by "delete_volume" :: held 3.468s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:45:37 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc595bf3-1429-48a2-b825-0c7ec24e10ce" returned: 0 in 9.014s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:37 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a48c0b6-5509-45db-a9fd-00a233579ae2]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:45:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:37 devstack sudo[98399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c
Jun 26 05:45:37 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:37 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=45,cinder:DELETE=2,cinder:SELECT=30,cinder:INSERT=7 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:45:39 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c" returned: 0 in 1.523s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:39 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Image conversion details: src /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c, size 1024.00 MB, duration 9.01 sec, destination /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc595bf3-1429-48a2-b825-0c7ec24e10ce {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 05:45:39 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Converted 1024.00 MB image at 113.59 MB/s
Jun 26 05:45:39 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc595bf3-1429-48a2-b825-0c7ec24e10ce is being set with open permissions: ugo+rw
Jun 26 05:45:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc595bf3-1429-48a2-b825-0c7ec24e10ce {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:39 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=40,cinder:SELECT=27,cinder:INSERT=13,cinder:DELETE=5 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:45:39 devstack sudo[98405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc595bf3-1429-48a2-b825-0c7ec24e10ce
Jun 26 05:45:39 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:40 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc595bf3-1429-48a2-b825-0c7ec24e10ce" returned: 0 in 0.980s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Lock "cinder-quobyte-dc595bf3-1429-48a2-b825-0c7ec24e10ce" released by "_copy_volume_from_snapshot" :: held 13.751s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:45:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Acquiring lock "cinder-quobyte-117249d7-9169-4fe7-be33-4a868da07a7a" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:45:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Lock "cinder-quobyte-117249d7-9169-4fe7-be33-4a868da07a7a" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:45:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Deleting offline snapshot 117249d7-9169-4fe7-be33-4a868da07a7a of volume a8b62d44-6f88-4df7-91fd-8000e5eb945c {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:45:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] snapshot_file for this snap is: volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:45:40 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ef626d-5ca0-4b15-bde1-9da4ac38f419]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:45:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:40 devstack sudo[98408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a
Jun 26 05:45:40 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:41 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a" returned: 0 in 1.636s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:45:41 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[de071c4e-5ffb-4c5a-9656-f890026bb185]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:45:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:42 devstack sudo[98419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c
Jun 26 05:45:42 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:43 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c" returned: 0 in 1.228s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:43 devstack sudo[98426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a
Jun 26 05:45:43 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:44 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a" returned: 0 in 1.863s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:45 devstack sudo[98432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a
Jun 26 05:45:45 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:46 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c.117249d7-9169-4fe7-be33-4a868da07a7a" returned: 0 in 1.981s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Lock "cinder-quobyte-117249d7-9169-4fe7-be33-4a868da07a7a" released by "_delete_snapshot" :: held 6.945s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:45:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 26.255s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:45:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62784c10-a385-487f-b649-93743c3fefe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc595bf3-1429-48a2-b825-0c7ec24e10ce', 'volume_size': 2, 'source_volid': 'a8b62d44-6f88-4df7-91fd-8000e5eb945c', 'source_volstatus': 'available'}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6888437-9393-4eea-ba5b-bcca4a63b5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:47 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Volume volume-dc595bf3-1429-48a2-b825-0c7ec24e10ce (dc595bf3-1429-48a2-b825-0c7ec24e10ce): created successfully
Jun 26 05:45:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6888437-9393-4eea-ba5b-bcca4a63b5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Flow 'volume_create_manager' (c3795bc4-c5bb-461d-83c0-9b1474fc72c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:45:47 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-42659cb6-98b6-44c5-9409-c6477b26a9a3 tempest-VolumesCloneTest-2072327378 None] Created volume successfully.
Jun 26 05:45:48 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-bb801126-d03e-4a88-9cd8-4838a28b9c1f tempest-VolumesCloneTest-2072327378 None] Acquiring lock "cinder-dc595bf3-1429-48a2-b825-0c7ec24e10ce-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:45:48 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-bb801126-d03e-4a88-9cd8-4838a28b9c1f tempest-VolumesCloneTest-2072327378 None] Lock "cinder-dc595bf3-1429-48a2-b825-0c7ec24e10ce-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:45:48 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-bb801126-d03e-4a88-9cd8-4838a28b9c1f tempest-VolumesCloneTest-2072327378 None] Acquiring lock "cinder-quobyte-dc595bf3-1429-48a2-b825-0c7ec24e10ce" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:45:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-bb801126-d03e-4a88-9cd8-4838a28b9c1f tempest-VolumesCloneTest-2072327378 None] Lock "cinder-quobyte-dc595bf3-1429-48a2-b825-0c7ec24e10ce" acquired by "delete_volume" :: waited 0.036s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:45:49 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a405917-ada8-43a7-bac4-4a8135d9b2b4]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:45:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bb801126-d03e-4a88-9cd8-4838a28b9c1f tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc595bf3-1429-48a2-b825-0c7ec24e10ce {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:49 devstack sudo[98472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc595bf3-1429-48a2-b825-0c7ec24e10ce
Jun 26 05:45:49 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:50 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bb801126-d03e-4a88-9cd8-4838a28b9c1f tempest-VolumesCloneTest-2072327378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc595bf3-1429-48a2-b825-0c7ec24e10ce" returned: 0 in 1.475s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bb801126-d03e-4a88-9cd8-4838a28b9c1f tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc595bf3-1429-48a2-b825-0c7ec24e10ce {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:50 devstack sudo[98510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc595bf3-1429-48a2-b825-0c7ec24e10ce
Jun 26 05:45:50 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:51 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bb801126-d03e-4a88-9cd8-4838a28b9c1f tempest-VolumesCloneTest-2072327378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dc595bf3-1429-48a2-b825-0c7ec24e10ce" returned: 0 in 0.952s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:51 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-bb801126-d03e-4a88-9cd8-4838a28b9c1f tempest-VolumesCloneTest-2072327378 None] Lock "cinder-quobyte-dc595bf3-1429-48a2-b825-0c7ec24e10ce" released by "delete_volume" :: held 2.564s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:45:51 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-bb801126-d03e-4a88-9cd8-4838a28b9c1f tempest-VolumesCloneTest-2072327378 None] Created reservations ['228eefc6-fe68-496f-ba1f-f4cddf616ea5', '32a3a79b-fd46-46af-8b32-30fe52ccf666', '009fc8e7-6885-49a8-a577-3a519b57fbff', '49bfe72b-38a1-4fc1-9ec5-ffb43bb38040'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:45:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-bb801126-d03e-4a88-9cd8-4838a28b9c1f tempest-VolumesCloneTest-2072327378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:45:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-bb801126-d03e-4a88-9cd8-4838a28b9c1f tempest-VolumesCloneTest-2072327378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:45:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-bb801126-d03e-4a88-9cd8-4838a28b9c1f tempest-VolumesCloneTest-2072327378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:45:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-bb801126-d03e-4a88-9cd8-4838a28b9c1f tempest-VolumesCloneTest-2072327378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:45:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-bb801126-d03e-4a88-9cd8-4838a28b9c1f tempest-VolumesCloneTest-2072327378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:45:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bb801126-d03e-4a88-9cd8-4838a28b9c1f tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:51 devstack sudo[98532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:45:51 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Flow 'volume_create_manager' (0263229f-b226-4ba7-ad56-fa221673ed35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21215024-932e-4909-bd02-7748682c27f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21215024-932e-4909-bd02-7748682c27f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1360762339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b729236-b910-4005-b309-e367d657b897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57359cf1ff4a4e78bd7dd1d89ab64e8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:45:52Z,use_quota=True,user_id='5a2dbddcf52a414b8865d2c559604848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426c0304-91db-4e2f-ab77-05483836a491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426c0304-91db-4e2f-ab77-05483836a491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ced2a8-79e6-46ba-b966-1ca8555db954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ced2a8-79e6-46ba-b966-1ca8555db954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b729236-b910-4005-b309-e367d657b897', 'volume_name': 'volume-5b729236-b910-4005-b309-e367d657b897', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b10ca20-12ab-425f-be8a-2bb6be4fc4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b10ca20-12ab-425f-be8a-2bb6be4fc4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a67d902-ec30-45df-b4d9-616a72f50dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:52 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Volume 5b729236-b910-4005-b309-e367d657b897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b729236-b910-4005-b309-e367d657b897', 'volume_size': 1}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1360762339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b729236-b910-4005-b309-e367d657b897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57359cf1ff4a4e78bd7dd1d89ab64e8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:45:52Z,use_quota=True,user_id='5a2dbddcf52a414b8865d2c559604848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Creating volume 5b729236-b910-4005-b309-e367d657b897 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:45:52 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b729236-b910-4005-b309-e367d657b897 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:52 devstack sudo[98535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b729236-b910-4005-b309-e367d657b897 1073741824
Jun 26 05:45:52 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-90e370c4-b5e4-4f53-8be1-3f29d3db47cc tempest-VolumesCloneTest-2072327378 None] Acquiring lock "cinder-a8b62d44-6f88-4df7-91fd-8000e5eb945c-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-90e370c4-b5e4-4f53-8be1-3f29d3db47cc tempest-VolumesCloneTest-2072327378 None] Lock "cinder-a8b62d44-6f88-4df7-91fd-8000e5eb945c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-90e370c4-b5e4-4f53-8be1-3f29d3db47cc tempest-VolumesCloneTest-2072327378 None] Acquiring lock "cinder-quobyte-a8b62d44-6f88-4df7-91fd-8000e5eb945c" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-90e370c4-b5e4-4f53-8be1-3f29d3db47cc tempest-VolumesCloneTest-2072327378 None] Lock "cinder-quobyte-a8b62d44-6f88-4df7-91fd-8000e5eb945c" acquired by "delete_volume" :: waited 0.052s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:45:52 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bb801126-d03e-4a88-9cd8-4838a28b9c1f tempest-VolumesCloneTest-2072327378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.148s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-bb801126-d03e-4a88-9cd8-4838a28b9c1f tempest-VolumesCloneTest-2072327378 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afe55c8-8c04-407d-9b45-cfaff58f0179]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:45:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-90e370c4-b5e4-4f53-8be1-3f29d3db47cc tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:52 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-bb801126-d03e-4a88-9cd8-4838a28b9c1f tempest-VolumesCloneTest-2072327378 None] Deleted volume successfully.
Jun 26 05:45:53 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-bb801126-d03e-4a88-9cd8-4838a28b9c1f tempest-VolumesCloneTest-2072327378 None] Lock "cinder-dc595bf3-1429-48a2-b825-0c7ec24e10ce-delete_volume" released by "delete_volume" :: held 4.121s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:45:53 devstack sudo[98541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c
Jun 26 05:45:53 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:53 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b729236-b910-4005-b309-e367d657b897 1073741824" returned: 0 in 1.405s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b729236-b910-4005-b309-e367d657b897 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:53 devstack sudo[98547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b729236-b910-4005-b309-e367d657b897
Jun 26 05:45:53 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:53 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-90e370c4-b5e4-4f53-8be1-3f29d3db47cc tempest-VolumesCloneTest-2072327378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c" returned: 0 in 0.913s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-90e370c4-b5e4-4f53-8be1-3f29d3db47cc tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:53 devstack sudo[98556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c
Jun 26 05:45:53 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:53 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-6de33814-3cad-41f9-9b54-e6841a14df11 tempest-GroupSnapshotsTest-1228317765 None] Group tempest-GroupSnapshotsTest-Group-1188333242: creating
Jun 26 05:45:54 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-6de33814-3cad-41f9-9b54-e6841a14df11 tempest-GroupSnapshotsTest-1228317765 None] Group tempest-GroupSnapshotsTest-Group-1188333242: created successfully
Jun 26 05:45:54 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-6de33814-3cad-41f9-9b54-e6841a14df11 tempest-GroupSnapshotsTest-1228317765 None] Create group completed successfully.
Jun 26 05:45:54 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b729236-b910-4005-b309-e367d657b897" returned: 0 in 0.818s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] <== create_volume: return (2282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:45:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.284s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:45:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a67d902-ec30-45df-b4d9-616a72f50dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b729236-b910-4005-b309-e367d657b897', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64bd0dbf-50be-4d2f-93ea-db4bb2f72917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:54 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Volume volume-5b729236-b910-4005-b309-e367d657b897 (5b729236-b910-4005-b309-e367d657b897): created successfully
Jun 26 05:45:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64bd0dbf-50be-4d2f-93ea-db4bb2f72917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Flow 'volume_create_manager' (0263229f-b226-4ba7-ad56-fa221673ed35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:45:54 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-9f840cda-e0f8-44f3-bd3f-29098cd3a606 tempest-TaggedAttachmentsTest-1544346299 None] Created volume successfully.
Jun 26 05:45:54 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-90e370c4-b5e4-4f53-8be1-3f29d3db47cc tempest-VolumesCloneTest-2072327378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8b62d44-6f88-4df7-91fd-8000e5eb945c" returned: 0 in 0.899s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:54 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-90e370c4-b5e4-4f53-8be1-3f29d3db47cc tempest-VolumesCloneTest-2072327378 None] Lock "cinder-quobyte-a8b62d44-6f88-4df7-91fd-8000e5eb945c" released by "delete_volume" :: held 1.930s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:45:54 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-90e370c4-b5e4-4f53-8be1-3f29d3db47cc tempest-VolumesCloneTest-2072327378 None] Created reservations ['d84c495c-426b-4e6c-832e-a99fe68936e8', '56af05a6-9ad8-4b75-a2df-c1c91b4629f4', '380a69a4-fd28-435a-b194-4cd747aeb3c8', '8d25bf97-5225-4142-98dc-a64107af9a25'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:45:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-90e370c4-b5e4-4f53-8be1-3f29d3db47cc tempest-VolumesCloneTest-2072327378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:45:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-90e370c4-b5e4-4f53-8be1-3f29d3db47cc tempest-VolumesCloneTest-2072327378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:45:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-90e370c4-b5e4-4f53-8be1-3f29d3db47cc tempest-VolumesCloneTest-2072327378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:45:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-90e370c4-b5e4-4f53-8be1-3f29d3db47cc tempest-VolumesCloneTest-2072327378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:45:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-90e370c4-b5e4-4f53-8be1-3f29d3db47cc tempest-VolumesCloneTest-2072327378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:45:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-90e370c4-b5e4-4f53-8be1-3f29d3db47cc tempest-VolumesCloneTest-2072327378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:55 devstack sudo[98613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:45:55 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:55 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-90e370c4-b5e4-4f53-8be1-3f29d3db47cc tempest-VolumesCloneTest-2072327378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.987s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:55 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-90e370c4-b5e4-4f53-8be1-3f29d3db47cc tempest-VolumesCloneTest-2072327378 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:45:55 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-90e370c4-b5e4-4f53-8be1-3f29d3db47cc tempest-VolumesCloneTest-2072327378 None] Deleted volume successfully.
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-90e370c4-b5e4-4f53-8be1-3f29d3db47cc tempest-VolumesCloneTest-2072327378 None] Lock "cinder-a8b62d44-6f88-4df7-91fd-8000e5eb945c-delete_volume" released by "delete_volume" :: held 3.328s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Flow 'volume_create_manager' (51f020ef-b894-4941-8cc5-1d35f030a451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6797a0-a1bd-428b-9411-c18f2abed4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6797a0-a1bd-428b-9411-c18f2abed4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-331995321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6a6ffff5-da0c-4e1c-85dc-f1da217d12d2,host='devstack@QuobyteHD#QuobyteHD',id=9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1cce988abe42d0a11308def29a3a67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:45:56Z,use_quota=True,user_id='cdbb601bdb8d43638e33d79778eb4210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80d578ed-5d1d-49e6-9e0b-ecef829c1c4f),volume_type_id=80d578ed-5d1d-49e6-9e0b-ecef829c1c4f)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29c96eb-e84b-4d4a-ba9a-27ea4d40e22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29c96eb-e84b-4d4a-ba9a-27ea4d40e22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c57284-51bf-432f-a3ba-8445189e80b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c57284-51bf-432f-a3ba-8445189e80b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244', 'volume_name': 'volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63558b4-3461-407b-ada2-4a29a064f0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63558b4-3461-407b-ada2-4a29a064f0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42e55f3-2e67-4390-b124-36ff4e120083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:56 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Volume 9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244', 'volume_size': 1}
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6a6ffff5-da0c-4e1c-85dc-f1da217d12d2,created_at=2026-06-26T03:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-331995321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6a6ffff5-da0c-4e1c-85dc-f1da217d12d2,host='devstack@QuobyteHD#QuobyteHD',id=9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1cce988abe42d0a11308def29a3a67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:45:56Z,use_quota=True,user_id='cdbb601bdb8d43638e33d79778eb4210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80d578ed-5d1d-49e6-9e0b-ecef829c1c4f),volume_type_id=80d578ed-5d1d-49e6-9e0b-ecef829c1c4f)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Creating volume 9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:45:56 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:45:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:56 devstack sudo[98618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244 1073741824
Jun 26 05:45:56 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:58 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244 1073741824" returned: 0 in 1.615s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:58 devstack sudo[98624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244
Jun 26 05:45:58 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Flow 'volume_create_manager' (87551389-5c1c-43ec-979d-4363ae70e493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6fe8236-ba3e-4f46-9003-e95f528008a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:59 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244" returned: 0 in 1.572s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] <== create_volume: return (3276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.280s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6fe8236-ba3e-4f46-9003-e95f528008a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-841455732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c92cfc5-6da9-4486-aa0f-028d907c3105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6e1152cdee400d853b7f0dc475e870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:46:00Z,use_quota=True,user_id='93df4e58f9184e7d834f73850c767dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e046abf0-cf88-4f6c-9713-e6ed81afd184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e046abf0-cf88-4f6c-9713-e6ed81afd184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568ac534-0f3a-4f76-9640-19fadec8d003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568ac534-0f3a-4f76-9640-19fadec8d003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c92cfc5-6da9-4486-aa0f-028d907c3105', 'volume_name': 'volume-0c92cfc5-6da9-4486-aa0f-028d907c3105', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f103e2e3-5d79-4a36-a7e1-5a5869d9a442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f103e2e3-5d79-4a36-a7e1-5a5869d9a442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc70fee-1a9d-484c-827d-c1db00bbdf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:59 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Volume 0c92cfc5-6da9-4486-aa0f-028d907c3105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c92cfc5-6da9-4486-aa0f-028d907c3105', 'volume_size': 1}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-841455732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c92cfc5-6da9-4486-aa0f-028d907c3105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6e1152cdee400d853b7f0dc475e870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:46:00Z,use_quota=True,user_id='93df4e58f9184e7d834f73850c767dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Creating volume 0c92cfc5-6da9-4486-aa0f-028d907c3105 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:45:59 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0c92cfc5-6da9-4486-aa0f-028d907c3105 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:45:59 devstack sudo[98633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0c92cfc5-6da9-4486-aa0f-028d907c3105 1073741824
Jun 26 05:45:59 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42e55f3-2e67-4390-b124-36ff4e120083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3d79c4-5d26-4fcc-ae03-52d7634145cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:45:59 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Volume volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244 (9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244): created successfully
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3d79c4-5d26-4fcc-ae03-52d7634145cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:45:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Flow 'volume_create_manager' (51f020ef-b894-4941-8cc5-1d35f030a451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:45:59 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-39868972-709c-4789-a693-caffd5a9089c tempest-GroupSnapshotsTest-1228317765 None] Created volume successfully.
Jun 26 05:46:01 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0c92cfc5-6da9-4486-aa0f-028d907c3105 1073741824" returned: 0 in 1.337s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0c92cfc5-6da9-4486-aa0f-028d907c3105 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:01 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-72386781-256b-4dc6-9ffd-8d4673bde5ca tempest-GroupSnapshotsTest-1228317765 None] GroupSnapshot 9a657d76-b9c6-4098-828d-795d55d5afd9: creating.
Jun 26 05:46:01 devstack sudo[98638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0c92cfc5-6da9-4486-aa0f-028d907c3105
Jun 26 05:46:01 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-72386781-256b-4dc6-9ffd-8d4673bde5ca tempest-GroupSnapshotsTest-1228317765 None] Group snapshot 9a657d76-b9c6-4098-828d-795d55d5afd9: creating. {{(pid=93708) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 26 05:46:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-72386781-256b-4dc6-9ffd-8d4673bde5ca tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:01 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:46:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Flow 'volume_create_manager' (2129fcbf-5343-4baf-86f9-c987b2363471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:46:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8433efc0-fb79-4eae-b330-edc368a42907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8433efc0-fb79-4eae-b330-edc368a42907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-314406893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaaae4f1-c557-4950-aef0-bfb349f2c9f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc2342b2651e47ff8384b5122c078ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:46:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:46:02Z,use_quota=True,user_id='b52deccac7254868b6894b099a2ae6f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e66a0070-b2f4-496a-883f-81bb3e961312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e66a0070-b2f4-496a-883f-81bb3e961312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b6a816-0746-4b5f-82c5-84425639ef80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b6a816-0746-4b5f-82c5-84425639ef80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaaae4f1-c557-4950-aef0-bfb349f2c9f7', 'volume_name': 'volume-aaaae4f1-c557-4950-aef0-bfb349f2c9f7', 'volume_size': 2}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81129dc5-37b1-4a10-b380-cec1cbc1fbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81129dc5-37b1-4a10-b380-cec1cbc1fbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (944f7a1b-898f-43f5-8a70-9d8911db3f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:01 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Volume aaaae4f1-c557-4950-aef0-bfb349f2c9f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaaae4f1-c557-4950-aef0-bfb349f2c9f7', 'volume_size': 2}
Jun 26 05:46:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:02 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0c92cfc5-6da9-4486-aa0f-028d907c3105" returned: 0 in 0.818s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] <== create_volume: return (2253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:46:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.256s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-72386781-256b-4dc6-9ffd-8d4673bde5ca tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.700s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-72386781-256b-4dc6-9ffd-8d4673bde5ca tempest-GroupSnapshotsTest-1228317765 None] Creating offline snapshot cefa4536-1d53-4fc6-9629-42a5836d812e of volume 9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244 {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:46:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc70fee-1a9d-484c-827d-c1db00bbdf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c92cfc5-6da9-4486-aa0f-028d907c3105', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b45074e-6ca7-474a-b38c-60fd0ec23f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:02 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[7911ca4f-db19-40d4-aa39-dc6e58773a29]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:46:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-72386781-256b-4dc6-9ffd-8d4673bde5ca tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:02 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Volume volume-0c92cfc5-6da9-4486-aa0f-028d907c3105 (0c92cfc5-6da9-4486-aa0f-028d907c3105): created successfully
Jun 26 05:46:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b45074e-6ca7-474a-b38c-60fd0ec23f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Flow 'volume_create_manager' (87551389-5c1c-43ec-979d-4363ae70e493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:46:02 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-d7db817e-c2cd-4add-90fc-c42393c659a0 tempest-ServerRescueNegativeTestJSON-557438386 None] Created volume successfully.
Jun 26 05:46:02 devstack sudo[98646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244
Jun 26 05:46:02 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:03 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-72386781-256b-4dc6-9ffd-8d4673bde5ca tempest-GroupSnapshotsTest-1228317765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244" returned: 0 in 0.900s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-72386781-256b-4dc6-9ffd-8d4673bde5ca tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:03 devstack sudo[98654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e 1G
Jun 26 05:46:03 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:04 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-72386781-256b-4dc6-9ffd-8d4673bde5ca tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e 1G" returned: 0 in 0.968s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-72386781-256b-4dc6-9ffd-8d4673bde5ca tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:04 devstack sudo[98661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e
Jun 26 05:46:04 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:05 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-72386781-256b-4dc6-9ffd-8d4673bde5ca tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e" returned: 0 in 0.993s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:05 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-72386781-256b-4dc6-9ffd-8d4673bde5ca tempest-GroupSnapshotsTest-1228317765 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 05:46:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-72386781-256b-4dc6-9ffd-8d4673bde5ca tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:05 devstack sudo[98668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e
Jun 26 05:46:05 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:05 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-72386781-256b-4dc6-9ffd-8d4673bde5ca tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e" returned: 0 in 0.681s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-72386781-256b-4dc6-9ffd-8d4673bde5ca tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:05 devstack sudo[98671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.info
Jun 26 05:46:05 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:06 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-72386781-256b-4dc6-9ffd-8d4673bde5ca tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.info" returned: 0 in 0.696s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:06 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-72386781-256b-4dc6-9ffd-8d4673bde5ca tempest-GroupSnapshotsTest-1228317765 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 05:46:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-72386781-256b-4dc6-9ffd-8d4673bde5ca tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:06 devstack sudo[98674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.info
Jun 26 05:46:06 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:07 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-72386781-256b-4dc6-9ffd-8d4673bde5ca tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.info" returned: 0 in 1.016s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-72386781-256b-4dc6-9ffd-8d4673bde5ca tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.365s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.737s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-314406893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaaae4f1-c557-4950-aef0-bfb349f2c9f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc2342b2651e47ff8384b5122c078ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:46:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:46:02Z,use_quota=True,user_id='b52deccac7254868b6894b099a2ae6f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:46:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Creating volume aaaae4f1-c557-4950-aef0-bfb349f2c9f7 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:46:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:46:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:46:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:46:07 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:46:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aaaae4f1-c557-4950-aef0-bfb349f2c9f7 2147483648 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:07 devstack sudo[98708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aaaae4f1-c557-4950-aef0-bfb349f2c9f7 2147483648
Jun 26 05:46:07 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:08 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-72386781-256b-4dc6-9ffd-8d4673bde5ca tempest-GroupSnapshotsTest-1228317765 None] group_snapshot 9a657d76-b9c6-4098-828d-795d55d5afd9: created successfully
Jun 26 05:46:09 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aaaae4f1-c557-4950-aef0-bfb349f2c9f7 2147483648" returned: 0 in 1.961s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aaaae4f1-c557-4950-aef0-bfb349f2c9f7 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:09 devstack sudo[98745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aaaae4f1-c557-4950-aef0-bfb349f2c9f7
Jun 26 05:46:09 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:10 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aaaae4f1-c557-4950-aef0-bfb349f2c9f7" returned: 0 in 1.001s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] <== create_volume: return (3030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.033s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (944f7a1b-898f-43f5-8a70-9d8911db3f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaaae4f1-c557-4950-aef0-bfb349f2c9f7', 'volume_size': 2}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0051e2-70dd-40f8-8c82-a4410b0caef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:10 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Volume volume-aaaae4f1-c557-4950-aef0-bfb349f2c9f7 (aaaae4f1-c557-4950-aef0-bfb349f2c9f7): created successfully
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0051e2-70dd-40f8-8c82-a4410b0caef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Flow 'volume_create_manager' (2129fcbf-5343-4baf-86f9-c987b2363471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:46:10 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-b99f492e-14c8-41ee-b750-dd6fe7306d2b tempest-VolumesCloneNegativeTest-1998601395 None] Created volume successfully.
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:10 devstack sudo[98767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:46:10 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "cinder-quobyte-cefa4536-1d53-4fc6-9629-42a5836d812e-be8e62be-7b8a-4c3d-b59e-1ce73799278c" by "_create_volume_from_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-cefa4536-1d53-4fc6-9629-42a5836d812e-be8e62be-7b8a-4c3d-b59e-1ce73799278c" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Creating volume be8e62be-7b8a-4c3d-b59e-1ce73799278c from snapshot cefa4536-1d53-4fc6-9629-42a5836d812e {{(pid=93708) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "cinder-quobyte-be8e62be-7b8a-4c3d-b59e-1ce73799278c" by "_copy_volume_from_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-be8e62be-7b8a-4c3d-b59e-1ce73799278c" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] snapshot: cefa4536-1d53-4fc6-9629-42a5836d812e, volume: be8e62be-7b8a-4c3d-b59e-1ce73799278c,  {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc06173-3383-4ba2-9560-c3356cfa3b3f]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:46:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:10 devstack sudo[98769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e
Jun 26 05:46:10 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:11 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.723s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:11 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:46:11 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:46:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 8 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:46:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:46:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a4414790-2484-424b-b652-c3ff76250c53 tempest-VolumesCloneNegativeTest-1998601395 None] Acquiring lock "cinder-aaaae4f1-c557-4950-aef0-bfb349f2c9f7-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:46:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a4414790-2484-424b-b652-c3ff76250c53 tempest-VolumesCloneNegativeTest-1998601395 None] Lock "cinder-aaaae4f1-c557-4950-aef0-bfb349f2c9f7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:46:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a4414790-2484-424b-b652-c3ff76250c53 tempest-VolumesCloneNegativeTest-1998601395 None] Acquiring lock "cinder-quobyte-aaaae4f1-c557-4950-aef0-bfb349f2c9f7" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:46:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a4414790-2484-424b-b652-c3ff76250c53 tempest-VolumesCloneNegativeTest-1998601395 None] Lock "cinder-quobyte-aaaae4f1-c557-4950-aef0-bfb349f2c9f7" acquired by "delete_volume" :: waited 0.022s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:46:11 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[23073c39-8c5c-4915-a7a6-73bef3cafe60]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:46:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a4414790-2484-424b-b652-c3ff76250c53 tempest-VolumesCloneNegativeTest-1998601395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aaaae4f1-c557-4950-aef0-bfb349f2c9f7 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:11 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e" returned: 0 in 0.977s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:46:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244 {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 05:46:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Creating direct copy from snapshot {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 05:46:11 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa7b93b-ca37-4bb1-857a-33031237a5c6]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:46:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:11 devstack sudo[98779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aaaae4f1-c557-4950-aef0-bfb349f2c9f7
Jun 26 05:46:11 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:11 devstack sudo[98780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244
Jun 26 05:46:11 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:12 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a4414790-2484-424b-b652-c3ff76250c53 tempest-VolumesCloneNegativeTest-1998601395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aaaae4f1-c557-4950-aef0-bfb349f2c9f7" returned: 0 in 0.851s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a4414790-2484-424b-b652-c3ff76250c53 tempest-VolumesCloneNegativeTest-1998601395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aaaae4f1-c557-4950-aef0-bfb349f2c9f7 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:12 devstack sudo[98789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aaaae4f1-c557-4950-aef0-bfb349f2c9f7
Jun 26 05:46:12 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:12 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244" returned: 0 in 0.865s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:12 devstack cinder-volume[93708]: DEBUG cinder.utils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Path /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-be8e62be-7b8a-4c3d-b59e-1ce73799278c not found in is_blk_device check {{(pid=93708) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 05:46:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-be8e62be-7b8a-4c3d-b59e-1ce73799278c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:12 devstack sudo[98791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-be8e62be-7b8a-4c3d-b59e-1ce73799278c
Jun 26 05:46:12 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:13 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a4414790-2484-424b-b652-c3ff76250c53 tempest-VolumesCloneNegativeTest-1998601395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aaaae4f1-c557-4950-aef0-bfb349f2c9f7" returned: 0 in 0.893s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:13 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a4414790-2484-424b-b652-c3ff76250c53 tempest-VolumesCloneNegativeTest-1998601395 None] Lock "cinder-quobyte-aaaae4f1-c557-4950-aef0-bfb349f2c9f7" released by "delete_volume" :: held 1.807s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:46:13 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-a4414790-2484-424b-b652-c3ff76250c53 tempest-VolumesCloneNegativeTest-1998601395 None] Created reservations ['8affbe34-fb57-44ed-b09d-f35249b91edb', 'c056aa13-54f0-43aa-a9c7-984923f4a6f7', 'c52e988a-ceee-4467-a4bb-4357ff6bc189', '1a077fa4-26c7-45dc-a4e3-a25a1d665ba3'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:46:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a4414790-2484-424b-b652-c3ff76250c53 tempest-VolumesCloneNegativeTest-1998601395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a4414790-2484-424b-b652-c3ff76250c53 tempest-VolumesCloneNegativeTest-1998601395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:13 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a4414790-2484-424b-b652-c3ff76250c53 tempest-VolumesCloneNegativeTest-1998601395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:46:13 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a4414790-2484-424b-b652-c3ff76250c53 tempest-VolumesCloneNegativeTest-1998601395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:46:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a4414790-2484-424b-b652-c3ff76250c53 tempest-VolumesCloneNegativeTest-1998601395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a4414790-2484-424b-b652-c3ff76250c53 tempest-VolumesCloneNegativeTest-1998601395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:13 devstack sudo[98818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:46:13 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:15 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a4414790-2484-424b-b652-c3ff76250c53 tempest-VolumesCloneNegativeTest-1998601395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 2.049s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:15 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-a4414790-2484-424b-b652-c3ff76250c53 tempest-VolumesCloneNegativeTest-1998601395 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:46:15 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-a4414790-2484-424b-b652-c3ff76250c53 tempest-VolumesCloneNegativeTest-1998601395 None] Deleted volume successfully.
Jun 26 05:46:15 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a4414790-2484-424b-b652-c3ff76250c53 tempest-VolumesCloneNegativeTest-1998601395 None] Lock "cinder-aaaae4f1-c557-4950-aef0-bfb349f2c9f7-delete_volume" released by "delete_volume" :: held 4.178s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:46:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-be8e62be-7b8a-4c3d-b59e-1ce73799278c" returned: 0 in 10.702s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:23 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[9442ceea-8e98-4e4c-92be-0d8e07342a90]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:46:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:23 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=39,cinder:SELECT=38,cinder:DELETE=2,cinder:INSERT=8 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:46:23 devstack sudo[99008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244
Jun 26 05:46:23 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:25 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=46,cinder:INSERT=10,cinder:SELECT=30,cinder:DELETE=6 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:46:25 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244" returned: 0 in 2.354s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:25 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Image conversion details: src /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244, size 1024.00 MB, duration 10.70 sec, destination /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-be8e62be-7b8a-4c3d-b59e-1ce73799278c {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 05:46:25 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Converted 1024.00 MB image at 95.67 MB/s
Jun 26 05:46:25 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-be8e62be-7b8a-4c3d-b59e-1ce73799278c is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 05:46:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-be8e62be-7b8a-4c3d-b59e-1ce73799278c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:25 devstack sudo[99014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-be8e62be-7b8a-4c3d-b59e-1ce73799278c
Jun 26 05:46:25 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Flow 'volume_create_manager' (64be0f62-f4a5-44a3-ba8d-73bf6debe5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:46:27 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60767982-0355-4842-aad0-38f62a277cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-be8e62be-7b8a-4c3d-b59e-1ce73799278c" returned: 0 in 1.625s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-be8e62be-7b8a-4c3d-b59e-1ce73799278c" released by "_copy_volume_from_snapshot" :: held 16.669s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60767982-0355-4842-aad0-38f62a277cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1592904080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=515ab7a3-2162-4748-9c6b-0c6480fe3321,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='61bd0850eed745969efac1e96f945ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:46:27Z,use_quota=True,user_id='38a474fa144f4b929a97b0c0d9219eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99613c0c-24b5-4324-90a0-b62ae8614e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99613c0c-24b5-4324-90a0-b62ae8614e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7acbd213-48f4-4dba-8207-5f95acff651c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7acbd213-48f4-4dba-8207-5f95acff651c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '515ab7a3-2162-4748-9c6b-0c6480fe3321', 'volume_name': 'volume-515ab7a3-2162-4748-9c6b-0c6480fe3321', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9c970d-700c-4ff4-b05f-072aab2262f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9c970d-700c-4ff4-b05f-072aab2262f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f752a18-f7e7-415a-9080-f9ec291f1a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:27 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Volume 515ab7a3-2162-4748-9c6b-0c6480fe3321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-515ab7a3-2162-4748-9c6b-0c6480fe3321', 'volume_size': 1}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-cefa4536-1d53-4fc6-9629-42a5836d812e-be8e62be-7b8a-4c3d-b59e-1ce73799278c" released by "_create_volume_from_snapshot" :: held 16.824s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 16.844s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1592904080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=515ab7a3-2162-4748-9c6b-0c6480fe3321,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='61bd0850eed745969efac1e96f945ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:46:27Z,use_quota=True,user_id='38a474fa144f4b929a97b0c0d9219eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Creating volume 515ab7a3-2162-4748-9c6b-0c6480fe3321 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:46:27 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:46:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-515ab7a3-2162-4748-9c6b-0c6480fe3321 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:27 devstack sudo[99017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-515ab7a3-2162-4748-9c6b-0c6480fe3321 1073741824
Jun 26 05:46:27 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:27 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-dad63266-f85d-4b0b-bc3e-bf6e309407db tempest-GroupSnapshotsTest-1228317765 None] Create group from source-snapshot-9a657d76-b9c6-4098-828d-795d55d5afd9 completed successfully.
Jun 26 05:46:29 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fa9797e2-633b-48aa-b376-fe28d9d43cb1 tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "cinder-quobyte-be8e62be-7b8a-4c3d-b59e-1ce73799278c" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:46:29 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-515ab7a3-2162-4748-9c6b-0c6480fe3321 1073741824" returned: 0 in 2.054s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:29 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fa9797e2-633b-48aa-b376-fe28d9d43cb1 tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-be8e62be-7b8a-4c3d-b59e-1ce73799278c" acquired by "delete_volume" :: waited 0.035s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:46:29 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2397d5-609c-4f28-8dbe-eb0a48c3cb2c]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:46:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fa9797e2-633b-48aa-b376-fe28d9d43cb1 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-be8e62be-7b8a-4c3d-b59e-1ce73799278c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-515ab7a3-2162-4748-9c6b-0c6480fe3321 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:29 devstack sudo[99066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-515ab7a3-2162-4748-9c6b-0c6480fe3321
Jun 26 05:46:29 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:29 devstack sudo[99065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-be8e62be-7b8a-4c3d-b59e-1ce73799278c
Jun 26 05:46:29 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:30 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-515ab7a3-2162-4748-9c6b-0c6480fe3321" returned: 0 in 1.184s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:30 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] <== create_volume: return (3341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:46:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.344s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:30 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fa9797e2-633b-48aa-b376-fe28d9d43cb1 tempest-GroupSnapshotsTest-1228317765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-be8e62be-7b8a-4c3d-b59e-1ce73799278c" returned: 0 in 1.242s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fa9797e2-633b-48aa-b376-fe28d9d43cb1 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-be8e62be-7b8a-4c3d-b59e-1ce73799278c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f752a18-f7e7-415a-9080-f9ec291f1a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-515ab7a3-2162-4748-9c6b-0c6480fe3321', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128d30d7-87d0-4fe7-952f-930029a6ed10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:30 devstack sudo[99090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-be8e62be-7b8a-4c3d-b59e-1ce73799278c
Jun 26 05:46:30 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:31 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Volume volume-515ab7a3-2162-4748-9c6b-0c6480fe3321 (515ab7a3-2162-4748-9c6b-0c6480fe3321): created successfully
Jun 26 05:46:31 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128d30d7-87d0-4fe7-952f-930029a6ed10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:31 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Flow 'volume_create_manager' (64be0f62-f4a5-44a3-ba8d-73bf6debe5b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:46:31 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-ec474d1b-78c6-44ae-91e5-24b358ca84af tempest-VolumesGetTest-148372371 None] Created volume successfully.
Jun 26 05:46:32 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fa9797e2-633b-48aa-b376-fe28d9d43cb1 tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-be8e62be-7b8a-4c3d-b59e-1ce73799278c" returned: 0 in 1.545s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fa9797e2-633b-48aa-b376-fe28d9d43cb1 tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-be8e62be-7b8a-4c3d-b59e-1ce73799278c" released by "delete_volume" :: held 2.865s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:46:32 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-fa9797e2-633b-48aa-b376-fe28d9d43cb1 tempest-GroupSnapshotsTest-1228317765 None] Created reservations ['d38e15fb-123d-4086-bd08-1152359e439c'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:46:32 devstack cinder-volume[93708]: WARNING cinder.quota [None req-fa9797e2-633b-48aa-b376-fe28d9d43cb1 tempest-GroupSnapshotsTest-1228317765 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-857657727 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-857657727, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:46:32 devstack cinder-volume[93708]: WARNING cinder.quota [None req-fa9797e2-633b-48aa-b376-fe28d9d43cb1 tempest-GroupSnapshotsTest-1228317765 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-857657727 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-857657727, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:46:32 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-fa9797e2-633b-48aa-b376-fe28d9d43cb1 tempest-GroupSnapshotsTest-1228317765 None] Created reservations ['ca6efcc5-c9e3-4d35-aef0-e4e4263bd77b', '80693ffe-2736-42f2-bb73-bab5bb40f76b', '42d5e4d6-50ba-4744-ba63-e618d718da0d', '5feff75f-c440-4bce-bf88-2d353de0d397'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:46:32 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:46:32 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Flow 'volume_create_manager' (38cbabf3-365b-44f8-9f44-45deb3fd4432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:46:32 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5ac709-d192-4cde-8b35-8409156412fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5ac709-d192-4cde-8b35-8409156412fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:46:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-226777202',display_name='tempest-VolumesGetTest-Volume-2087122459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa39051-cf8c-4f45-ae39-b4e1e913c7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61bd0850eed745969efac1e96f945ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:46:33Z,use_quota=True,user_id='38a474fa144f4b929a97b0c0d9219eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437fb301-16a7-4629-b3da-03344ec2d9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437fb301-16a7-4629-b3da-03344ec2d9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23d4501-0d16-44ee-822c-4daa38d86ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23d4501-0d16-44ee-822c-4daa38d86ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffa39051-cf8c-4f45-ae39-b4e1e913c7c1', 'volume_name': 'volume-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817749a9-36cf-4ffa-8ef4-fdfa19379d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817749a9-36cf-4ffa-8ef4-fdfa19379d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5dc3252-0db7-4b2f-9a6e-bbb16e35bc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:33 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Volume ffa39051-cf8c-4f45-ae39-b4e1e913c7c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1', 'volume_size': 1}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:46:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-226777202',display_name='tempest-VolumesGetTest-Volume-2087122459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa39051-cf8c-4f45-ae39-b4e1e913c7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61bd0850eed745969efac1e96f945ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:46:33Z,use_quota=True,user_id='38a474fa144f4b929a97b0c0d9219eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Creating volume ffa39051-cf8c-4f45-ae39-b4e1e913c7c1 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:46:33 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fa9797e2-633b-48aa-b376-fe28d9d43cb1 tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fa9797e2-633b-48aa-b376-fe28d9d43cb1 tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-fa9797e2-633b-48aa-b376-fe28d9d43cb1 tempest-GroupSnapshotsTest-1228317765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-fa9797e2-633b-48aa-b376-fe28d9d43cb1 tempest-GroupSnapshotsTest-1228317765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fa9797e2-633b-48aa-b376-fe28d9d43cb1 tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fa9797e2-633b-48aa-b376-fe28d9d43cb1 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:33 devstack sudo[99132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1 1073741824
Jun 26 05:46:33 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:33 devstack sudo[99134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:46:33 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:34 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] group_snapshot 9a657d76-b9c6-4098-828d-795d55d5afd9: deleting
Jun 26 05:46:34 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] group_snapshot 9a657d76-b9c6-4098-828d-795d55d5afd9: deleting {{(pid=93708) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 26 05:46:34 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fa9797e2-633b-48aa-b376-fe28d9d43cb1 tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.113s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:34 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-fa9797e2-633b-48aa-b376-fe28d9d43cb1 tempest-GroupSnapshotsTest-1228317765 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:46:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "cinder-quobyte-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:46:34 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-fa9797e2-633b-48aa-b376-fe28d9d43cb1 tempest-GroupSnapshotsTest-1228317765 None] Delete group completed successfully.
Jun 26 05:46:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244" acquired by "delete_snapshot" :: waited 0.041s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:46:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "cinder-quobyte-cefa4536-1d53-4fc6-9629-42a5836d812e" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:46:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-cefa4536-1d53-4fc6-9629-42a5836d812e" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:46:34 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] Deleting offline snapshot cefa4536-1d53-4fc6-9629-42a5836d812e of volume 9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:46:34 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] snapshot_file for this snap is: volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:46:34 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e68325a-739d-4b85-8a27-68c695995f51]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:46:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:34 devstack sudo[99143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e
Jun 26 05:46:34 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:34 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1 1073741824" returned: 0 in 1.553s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:34 devstack sudo[99145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1
Jun 26 05:46:34 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4a6cd340-ffa7-4f9f-9870-d035ad67ab0b tempest-ServerRescueNegativeTestJSON-557438386 None] Acquiring lock "cinder-0c92cfc5-6da9-4486-aa0f-028d907c3105-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:46:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4a6cd340-ffa7-4f9f-9870-d035ad67ab0b tempest-ServerRescueNegativeTestJSON-557438386 None] Lock "cinder-0c92cfc5-6da9-4486-aa0f-028d907c3105-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:46:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4a6cd340-ffa7-4f9f-9870-d035ad67ab0b tempest-ServerRescueNegativeTestJSON-557438386 None] Acquiring lock "cinder-quobyte-0c92cfc5-6da9-4486-aa0f-028d907c3105" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:46:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4a6cd340-ffa7-4f9f-9870-d035ad67ab0b tempest-ServerRescueNegativeTestJSON-557438386 None] Lock "cinder-quobyte-0c92cfc5-6da9-4486-aa0f-028d907c3105" acquired by "delete_volume" :: waited 0.057s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:46:35 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c74f008-9ab0-49b1-98c6-b1be774a7a51]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:46:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4a6cd340-ffa7-4f9f-9870-d035ad67ab0b tempest-ServerRescueNegativeTestJSON-557438386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0c92cfc5-6da9-4486-aa0f-028d907c3105 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:35 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e" returned: 0 in 1.227s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:35 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:46:35 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaa20ef-b45c-4f9e-8718-68fac16dd147]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:46:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:35 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1" returned: 0 in 1.051s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:35 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] <== create_volume: return (2682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:46:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.684s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5dc3252-0db7-4b2f-9a6e-bbb16e35bc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f387e3-313a-4ca5-a16b-09cc68d5af7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:35 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Volume volume-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1 (ffa39051-cf8c-4f45-ae39-b4e1e913c7c1): created successfully
Jun 26 05:46:35 devstack sudo[99152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0c92cfc5-6da9-4486-aa0f-028d907c3105
Jun 26 05:46:35 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f387e3-313a-4ca5-a16b-09cc68d5af7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Flow 'volume_create_manager' (38cbabf3-365b-44f8-9f44-45deb3fd4432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:46:35 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-903ef6b1-989a-4451-a8c5-806469c2574e tempest-VolumesGetTest-148372371 None] Created volume successfully.
Jun 26 05:46:35 devstack sudo[99153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244
Jun 26 05:46:35 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-54f439ff-df6b-48d9-ae6e-95c2d46293c5 tempest-VolumesGetTest-148372371 None] Acquiring lock "cinder-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:46:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-54f439ff-df6b-48d9-ae6e-95c2d46293c5 tempest-VolumesGetTest-148372371 None] Lock "cinder-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:46:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-54f439ff-df6b-48d9-ae6e-95c2d46293c5 tempest-VolumesGetTest-148372371 None] Acquiring lock "cinder-quobyte-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:46:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-54f439ff-df6b-48d9-ae6e-95c2d46293c5 tempest-VolumesGetTest-148372371 None] Lock "cinder-quobyte-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1" acquired by "delete_volume" :: waited 0.026s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:46:36 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edae9fa-ee3e-42a9-8435-30b4a49a5ec7]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:46:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-54f439ff-df6b-48d9-ae6e-95c2d46293c5 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:36 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4a6cd340-ffa7-4f9f-9870-d035ad67ab0b tempest-ServerRescueNegativeTestJSON-557438386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0c92cfc5-6da9-4486-aa0f-028d907c3105" returned: 0 in 1.283s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4a6cd340-ffa7-4f9f-9870-d035ad67ab0b tempest-ServerRescueNegativeTestJSON-557438386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0c92cfc5-6da9-4486-aa0f-028d907c3105 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:36 devstack sudo[99159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1
Jun 26 05:46:36 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:36 devstack sudo[99163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0c92cfc5-6da9-4486-aa0f-028d907c3105
Jun 26 05:46:36 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:37 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244" returned: 0 in 1.508s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:37 devstack sudo[99166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e
Jun 26 05:46:37 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:37 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4a6cd340-ffa7-4f9f-9870-d035ad67ab0b tempest-ServerRescueNegativeTestJSON-557438386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0c92cfc5-6da9-4486-aa0f-028d907c3105" returned: 0 in 0.994s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4a6cd340-ffa7-4f9f-9870-d035ad67ab0b tempest-ServerRescueNegativeTestJSON-557438386 None] Lock "cinder-quobyte-0c92cfc5-6da9-4486-aa0f-028d907c3105" released by "delete_volume" :: held 2.368s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:46:37 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-54f439ff-df6b-48d9-ae6e-95c2d46293c5 tempest-VolumesGetTest-148372371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1" returned: 0 in 1.257s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-54f439ff-df6b-48d9-ae6e-95c2d46293c5 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:38 devstack sudo[99190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1
Jun 26 05:46:38 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:38 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-4a6cd340-ffa7-4f9f-9870-d035ad67ab0b tempest-ServerRescueNegativeTestJSON-557438386 None] Created reservations ['fb237a05-c358-4819-8237-097583c9bef3', '23ed159a-db4a-41ed-ba38-22756d38afc4', '3d1358ec-a058-4387-abdd-81edfec0558d', 'ca1f4487-a3de-485d-a596-96d3ae3a3494'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:46:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4a6cd340-ffa7-4f9f-9870-d035ad67ab0b tempest-ServerRescueNegativeTestJSON-557438386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4a6cd340-ffa7-4f9f-9870-d035ad67ab0b tempest-ServerRescueNegativeTestJSON-557438386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:38 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4a6cd340-ffa7-4f9f-9870-d035ad67ab0b tempest-ServerRescueNegativeTestJSON-557438386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:46:38 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4a6cd340-ffa7-4f9f-9870-d035ad67ab0b tempest-ServerRescueNegativeTestJSON-557438386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:46:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4a6cd340-ffa7-4f9f-9870-d035ad67ab0b tempest-ServerRescueNegativeTestJSON-557438386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4a6cd340-ffa7-4f9f-9870-d035ad67ab0b tempest-ServerRescueNegativeTestJSON-557438386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:38 devstack sudo[99192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:46:38 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:38 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e" returned: 0 in 1.133s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:38 devstack sudo[99194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e
Jun 26 05:46:38 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:39 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4a6cd340-ffa7-4f9f-9870-d035ad67ab0b tempest-ServerRescueNegativeTestJSON-557438386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.861s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:39 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-4a6cd340-ffa7-4f9f-9870-d035ad67ab0b tempest-ServerRescueNegativeTestJSON-557438386 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:46:39 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-4a6cd340-ffa7-4f9f-9870-d035ad67ab0b tempest-ServerRescueNegativeTestJSON-557438386 None] Deleted volume successfully.
Jun 26 05:46:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4a6cd340-ffa7-4f9f-9870-d035ad67ab0b tempest-ServerRescueNegativeTestJSON-557438386 None] Lock "cinder-0c92cfc5-6da9-4486-aa0f-028d907c3105-delete_volume" released by "delete_volume" :: held 3.759s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:46:39 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244.cefa4536-1d53-4fc6-9629-42a5836d812e" returned: 0 in 0.948s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:39 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-54f439ff-df6b-48d9-ae6e-95c2d46293c5 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1" returned: 0 in 1.269s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-cefa4536-1d53-4fc6-9629-42a5836d812e" released by "_delete_snapshot" :: held 4.967s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:46:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-54f439ff-df6b-48d9-ae6e-95c2d46293c5 tempest-VolumesGetTest-148372371 None] Lock "cinder-quobyte-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1" released by "delete_volume" :: held 2.608s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:46:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244" released by "delete_snapshot" :: held 5.016s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:46:39 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-54f439ff-df6b-48d9-ae6e-95c2d46293c5 tempest-VolumesGetTest-148372371 None] Created reservations ['0cb9016b-7080-433e-ae8d-bcb5680f83f7', '4541eb9e-c40c-436b-be7b-a13d41d34604', '28523c88-84fc-403d-a844-a0b50e2a5a31', '1a8cf868-54b2-4950-b4e4-5dba2d8f3025'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:46:39 devstack cinder-volume[93708]: WARNING cinder.quota [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-857657727 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-857657727, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:46:39 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] Created reservations ['5cc18d99-b437-481c-b45e-b38735098fe2', '4c0798a2-2dab-4953-8468-b14c18240f06', '19da8c0e-2a6d-4ec6-a318-0761a1670754', '7913ef80-f2e5-4cd9-88e0-b3d1f442b4f9'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:46:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-54f439ff-df6b-48d9-ae6e-95c2d46293c5 tempest-VolumesGetTest-148372371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-54f439ff-df6b-48d9-ae6e-95c2d46293c5 tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-54f439ff-df6b-48d9-ae6e-95c2d46293c5 tempest-VolumesGetTest-148372371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:46:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-54f439ff-df6b-48d9-ae6e-95c2d46293c5 tempest-VolumesGetTest-148372371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:46:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-54f439ff-df6b-48d9-ae6e-95c2d46293c5 tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-54f439ff-df6b-48d9-ae6e-95c2d46293c5 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:39 devstack sudo[99200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:46:39 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:39 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-84380627-1ffa-4a86-9ee8-270c1d304aa1 tempest-GroupSnapshotsTest-1228317765 None] group_snapshot 9a657d76-b9c6-4098-828d-795d55d5afd9: deleted successfully
Jun 26 05:46:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6bee7a21-871b-41df-b8fc-c823e6aeb3ae tempest-VolumesGetTest-148372371 None] Acquiring lock "cinder-515ab7a3-2162-4748-9c6b-0c6480fe3321-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:46:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c6b80fa7-8c79-4743-88e3-7d9ff1487978 tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "cinder-quobyte-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:46:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6bee7a21-871b-41df-b8fc-c823e6aeb3ae tempest-VolumesGetTest-148372371 None] Lock "cinder-515ab7a3-2162-4748-9c6b-0c6480fe3321-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:46:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c6b80fa7-8c79-4743-88e3-7d9ff1487978 tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244" acquired by "delete_volume" :: waited 0.059s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:46:40 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc438ab-5f13-4df4-bca0-cfd5beace9ee]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:46:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c6b80fa7-8c79-4743-88e3-7d9ff1487978 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6bee7a21-871b-41df-b8fc-c823e6aeb3ae tempest-VolumesGetTest-148372371 None] Acquiring lock "cinder-quobyte-515ab7a3-2162-4748-9c6b-0c6480fe3321" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:46:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6bee7a21-871b-41df-b8fc-c823e6aeb3ae tempest-VolumesGetTest-148372371 None] Lock "cinder-quobyte-515ab7a3-2162-4748-9c6b-0c6480fe3321" acquired by "delete_volume" :: waited 0.053s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:46:40 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[297210bc-de08-4f9e-a84c-0fbb5bc11c74]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:46:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6bee7a21-871b-41df-b8fc-c823e6aeb3ae tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-515ab7a3-2162-4748-9c6b-0c6480fe3321 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:40 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-54f439ff-df6b-48d9-ae6e-95c2d46293c5 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.237s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:40 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-54f439ff-df6b-48d9-ae6e-95c2d46293c5 tempest-VolumesGetTest-148372371 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:46:40 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-54f439ff-df6b-48d9-ae6e-95c2d46293c5 tempest-VolumesGetTest-148372371 None] Deleted volume successfully.
Jun 26 05:46:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-54f439ff-df6b-48d9-ae6e-95c2d46293c5 tempest-VolumesGetTest-148372371 None] Lock "cinder-ffa39051-cf8c-4f45-ae39-b4e1e913c7c1-delete_volume" released by "delete_volume" :: held 4.253s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:46:40 devstack sudo[99219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244
Jun 26 05:46:40 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:40 devstack sudo[99239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-515ab7a3-2162-4748-9c6b-0c6480fe3321
Jun 26 05:46:40 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:41 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:41 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6bee7a21-871b-41df-b8fc-c823e6aeb3ae tempest-VolumesGetTest-148372371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-515ab7a3-2162-4748-9c6b-0c6480fe3321" returned: 0 in 1.191s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6bee7a21-871b-41df-b8fc-c823e6aeb3ae tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-515ab7a3-2162-4748-9c6b-0c6480fe3321 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c6b80fa7-8c79-4743-88e3-7d9ff1487978 tempest-GroupSnapshotsTest-1228317765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244" returned: 0 in 1.440s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c6b80fa7-8c79-4743-88e3-7d9ff1487978 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:41 devstack sudo[99258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244
Jun 26 05:46:41 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:41 devstack sudo[99257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-515ab7a3-2162-4748-9c6b-0c6480fe3321
Jun 26 05:46:41 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:42 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c6b80fa7-8c79-4743-88e3-7d9ff1487978 tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244" returned: 0 in 0.956s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c6b80fa7-8c79-4743-88e3-7d9ff1487978 tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-9fe92ea7-1e1a-4d4c-90bd-ab071fe6a244" released by "delete_volume" :: held 2.538s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:46:42 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6bee7a21-871b-41df-b8fc-c823e6aeb3ae tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-515ab7a3-2162-4748-9c6b-0c6480fe3321" returned: 0 in 1.055s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6bee7a21-871b-41df-b8fc-c823e6aeb3ae tempest-VolumesGetTest-148372371 None] Lock "cinder-quobyte-515ab7a3-2162-4748-9c6b-0c6480fe3321" released by "delete_volume" :: held 2.385s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:46:42 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-c6b80fa7-8c79-4743-88e3-7d9ff1487978 tempest-GroupSnapshotsTest-1228317765 None] Created reservations ['bf773f88-068a-4f91-b633-5a6ca3e7d3e8'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:46:43 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-6bee7a21-871b-41df-b8fc-c823e6aeb3ae tempest-VolumesGetTest-148372371 None] Created reservations ['090494ff-edd6-41ec-992d-d7430aeec2db', '646e54d9-a7ef-4ec0-b6d5-a28e97c8b6b1', '0e111464-d482-4b9f-8df6-c9fde14628a6', 'cc503d6f-8e4f-4f7d-8369-a6859799306a'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:46:43 devstack cinder-volume[93708]: WARNING cinder.db.api [None req-c6b80fa7-8c79-4743-88e3-7d9ff1487978 tempest-GroupSnapshotsTest-1228317765 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-857657727']
Jun 26 05:46:43 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-c6b80fa7-8c79-4743-88e3-7d9ff1487978 tempest-GroupSnapshotsTest-1228317765 None] Created reservations ['2849bd8a-cfa5-46ea-a0ce-2b745dab4128', '34f5f76e-7961-4ef7-8e70-7e95dc803890', 'e8359b11-ba76-407e-8be8-364f6901686f', '43fbdfdc-6a41-4e82-9186-9d32e178d96a'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:46:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6bee7a21-871b-41df-b8fc-c823e6aeb3ae tempest-VolumesGetTest-148372371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6bee7a21-871b-41df-b8fc-c823e6aeb3ae tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:43 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6bee7a21-871b-41df-b8fc-c823e6aeb3ae tempest-VolumesGetTest-148372371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:46:43 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6bee7a21-871b-41df-b8fc-c823e6aeb3ae tempest-VolumesGetTest-148372371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:46:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6bee7a21-871b-41df-b8fc-c823e6aeb3ae tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6bee7a21-871b-41df-b8fc-c823e6aeb3ae tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:43 devstack sudo[99264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:46:43 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c6b80fa7-8c79-4743-88e3-7d9ff1487978 tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c6b80fa7-8c79-4743-88e3-7d9ff1487978 tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:43 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c6b80fa7-8c79-4743-88e3-7d9ff1487978 tempest-GroupSnapshotsTest-1228317765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:46:43 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c6b80fa7-8c79-4743-88e3-7d9ff1487978 tempest-GroupSnapshotsTest-1228317765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:46:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c6b80fa7-8c79-4743-88e3-7d9ff1487978 tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c6b80fa7-8c79-4743-88e3-7d9ff1487978 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:43 devstack sudo[99266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:46:43 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:44 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-daa3fb24-d029-41f7-9640-ec1490dc5ae3 tempest-GroupSnapshotsTest-1228317765 None] Group tempest-GroupSnapshotsTest-Group-1847404338: creating
Jun 26 05:46:44 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-daa3fb24-d029-41f7-9640-ec1490dc5ae3 tempest-GroupSnapshotsTest-1228317765 None] Group tempest-GroupSnapshotsTest-Group-1847404338: created successfully
Jun 26 05:46:44 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-daa3fb24-d029-41f7-9640-ec1490dc5ae3 tempest-GroupSnapshotsTest-1228317765 None] Create group completed successfully.
Jun 26 05:46:44 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c6b80fa7-8c79-4743-88e3-7d9ff1487978 tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.034s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-c6b80fa7-8c79-4743-88e3-7d9ff1487978 tempest-GroupSnapshotsTest-1228317765 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:46:44 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-c6b80fa7-8c79-4743-88e3-7d9ff1487978 tempest-GroupSnapshotsTest-1228317765 None] Delete group completed successfully.
Jun 26 05:46:44 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6bee7a21-871b-41df-b8fc-c823e6aeb3ae tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.275s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-6bee7a21-871b-41df-b8fc-c823e6aeb3ae tempest-VolumesGetTest-148372371 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:46:44 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-6bee7a21-871b-41df-b8fc-c823e6aeb3ae tempest-VolumesGetTest-148372371 None] Deleted volume successfully.
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6bee7a21-871b-41df-b8fc-c823e6aeb3ae tempest-VolumesGetTest-148372371 None] Lock "cinder-515ab7a3-2162-4748-9c6b-0c6480fe3321-delete_volume" released by "delete_volume" :: held 4.134s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Flow 'volume_create_manager' (69fc87ae-ac38-4aa8-8593-d04819bef38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4b8088-2f13-4add-9b2e-67ee0c2ef89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4b8088-2f13-4add-9b2e-67ee0c2ef89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-849637526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61bd0850eed745969efac1e96f945ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:46:44Z,use_quota=True,user_id='38a474fa144f4b929a97b0c0d9219eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5af81e-dd74-4a03-9e0c-54f74e76efc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5af81e-dd74-4a03-9e0c-54f74e76efc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044b8531-26e7-40d0-9c0e-904a7d36edcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044b8531-26e7-40d0-9c0e-904a7d36edcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8', 'volume_name': 'volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf42785-4f09-4354-939b-86410f4f1a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf42785-4f09-4354-939b-86410f4f1a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f927bb6a-f0ad-42b7-946a-67c8cb7b45fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:44 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Volume 2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8', 'volume_size': 1}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-849637526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61bd0850eed745969efac1e96f945ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:46:44Z,use_quota=True,user_id='38a474fa144f4b929a97b0c0d9219eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Creating volume 2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:46:44 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:46:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:44 devstack sudo[99270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 1073741824
Jun 26 05:46:44 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:45 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 1073741824" returned: 0 in 1.002s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:45 devstack sudo[99275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8
Jun 26 05:46:45 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Flow 'volume_create_manager' (acb37b9a-664d-4072-9b95-d1a4107c752d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (899a67bc-4ce9-4817-b792-fbe5beb2e9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (899a67bc-4ce9-4817-b792-fbe5beb2e9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1838000229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a6103800-1c50-4b3d-b335-ac39fd80f8f6,host='devstack@QuobyteHD#QuobyteHD',id=c15865b7-8642-41f2-bfcd-d63cc8a3eed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1cce988abe42d0a11308def29a3a67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:46:46Z,use_quota=True,user_id='cdbb601bdb8d43638e33d79778eb4210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91ade78b-3fcd-46d2-ab6c-8184897cfd33),volume_type_id=91ade78b-3fcd-46d2-ab6c-8184897cfd33)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28804b90-f2bc-42e0-bc32-455603d8c204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28804b90-f2bc-42e0-bc32-455603d8c204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfdf73f-3890-486f-950e-58d34d8db50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfdf73f-3890-486f-950e-58d34d8db50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c15865b7-8642-41f2-bfcd-d63cc8a3eed1', 'volume_name': 'volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87699309-70e5-4806-8b14-8137c1fb9646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87699309-70e5-4806-8b14-8137c1fb9646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0165be6c-2b05-4ac6-8e97-a39e64adca21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:46 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Volume c15865b7-8642-41f2-bfcd-d63cc8a3eed1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1', 'volume_size': 1}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:46 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8" returned: 0 in 1.007s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.082s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.356s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a6103800-1c50-4b3d-b335-ac39fd80f8f6,created_at=2026-06-26T03:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1838000229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a6103800-1c50-4b3d-b335-ac39fd80f8f6,host='devstack@QuobyteHD#QuobyteHD',id=c15865b7-8642-41f2-bfcd-d63cc8a3eed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1cce988abe42d0a11308def29a3a67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:46:46Z,use_quota=True,user_id='cdbb601bdb8d43638e33d79778eb4210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91ade78b-3fcd-46d2-ab6c-8184897cfd33),volume_type_id=91ade78b-3fcd-46d2-ab6c-8184897cfd33)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Creating volume c15865b7-8642-41f2-bfcd-d63cc8a3eed1 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:46:46 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:46 devstack sudo[99278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1 1073741824
Jun 26 05:46:46 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f927bb6a-f0ad-42b7-946a-67c8cb7b45fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b6edcd-4acf-43ea-b5ba-72bd351d96f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:46 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Volume volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 (2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8): created successfully
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b6edcd-4acf-43ea-b5ba-72bd351d96f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Flow 'volume_create_manager' (69fc87ae-ac38-4aa8-8593-d04819bef38d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:46:46 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-9c08761d-e219-4a63-a881-165a027ffbc7 tempest-VolumesGetTest-148372371 None] Created volume successfully.
Jun 26 05:46:47 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1 1073741824" returned: 0 in 1.062s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:47 devstack sudo[99290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1
Jun 26 05:46:47 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Flow 'volume_create_manager' (2cab46ac-f686-4614-b457-de9120dc70eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a5cf49-75b0-4406-a1fd-9b24aae1fd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a5cf49-75b0-4406-a1fd-9b24aae1fd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1298436740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5efb5da-e101-48a3-a44e-f750be329a58,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='61bd0850eed745969efac1e96f945ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8,status='creating',terminated_at=None,updated_at=2026-06-26T03:46:48Z,use_quota=True,user_id='38a474fa144f4b929a97b0c0d9219eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11459a2f-2ee1-4791-b030-5045605a3738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11459a2f-2ee1-4791-b030-5045605a3738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae6ddb93-2e5b-4e4e-8ce9-da04929b85e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae6ddb93-2e5b-4e4e-8ce9-da04929b85e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c5efb5da-e101-48a3-a44e-f750be329a58', 'volume_name': 'volume-c5efb5da-e101-48a3-a44e-f750be329a58', 'volume_size': 1, 'source_volid': '2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8', 'source_volstatus': 'available'}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d4a9eb-fe15-49be-a1b3-0ba42ebd6308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d4a9eb-fe15-49be-a1b3-0ba42ebd6308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f001299-bafb-41ee-9468-bdd6c7a02fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:48 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Volume c5efb5da-e101-48a3-a44e-f750be329a58: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c5efb5da-e101-48a3-a44e-f750be329a58', 'volume_size': 1, 'source_volid': '2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8', 'source_volstatus': 'available'}
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:48 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1" returned: 0 in 0.701s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.126s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:48 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Cloning volume 2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 to volume c5efb5da-e101-48a3-a44e-f750be329a58
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0165be6c-2b05-4ac6-8e97-a39e64adca21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1f25555-8383-4065-a482-da8f8f129152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:48 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Volume volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1 (c15865b7-8642-41f2-bfcd-d63cc8a3eed1): created successfully
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1f25555-8383-4065-a482-da8f8f129152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Flow 'volume_create_manager' (acb37b9a-664d-4072-9b95-d1a4107c752d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Creating offline snapshot 11c47469-d0ca-4484-bc8b-51778e3e36c3 of volume 2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:46:48 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-bf603fd1-e950-4cfc-b049-0429e09f84fc tempest-GroupSnapshotsTest-1228317765 None] Created volume successfully.
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[745ab296-02ff-4b9a-be8f-4424df8cfa1d]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:46:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:48 devstack sudo[99314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8
Jun 26 05:46:48 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:49 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8" returned: 0 in 0.925s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:49 devstack sudo[99343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3 1G
Jun 26 05:46:49 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:50 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:46:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Flow 'volume_create_manager' (c02b9e36-b03f-48ac-a8e9-2ba206d0f764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:46:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5411c0-4276-433c-bbd8-282f5190701d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5411c0-4276-433c-bbd8-282f5190701d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1245720231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a6103800-1c50-4b3d-b335-ac39fd80f8f6,host='devstack@QuobyteHD#QuobyteHD',id=168a7d60-1266-4e12-a835-2249789d9175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1cce988abe42d0a11308def29a3a67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:46:50Z,use_quota=True,user_id='cdbb601bdb8d43638e33d79778eb4210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91ade78b-3fcd-46d2-ab6c-8184897cfd33),volume_type_id=91ade78b-3fcd-46d2-ab6c-8184897cfd33)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1543f659-98c6-4afb-9074-d0d23575c2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1543f659-98c6-4afb-9074-d0d23575c2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6344eea3-203c-49d0-91c5-d3aa77ddbaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6344eea3-203c-49d0-91c5-d3aa77ddbaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '168a7d60-1266-4e12-a835-2249789d9175', 'volume_name': 'volume-168a7d60-1266-4e12-a835-2249789d9175', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffb3092a-f128-400f-8c0d-9598c9ad0622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffb3092a-f128-400f-8c0d-9598c9ad0622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:46:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc03ed0-d8f1-4f7c-9074-ac7d76868b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:46:50 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Volume 168a7d60-1266-4e12-a835-2249789d9175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-168a7d60-1266-4e12-a835-2249789d9175', 'volume_size': 1}
Jun 26 05:46:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:50 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3 1G" returned: 0 in 0.971s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:50 devstack sudo[99353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3
Jun 26 05:46:50 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:51 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3" returned: 0 in 0.727s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:51 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3 is being set with open permissions: ugo+rw
Jun 26 05:46:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:51 devstack sudo[99361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3
Jun 26 05:46:51 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:51 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3" returned: 0 in 0.693s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:52 devstack sudo[99372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.info
Jun 26 05:46:52 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:52 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.info" returned: 0 in 0.743s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:52 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.info is being set with open permissions: ugo+rw
Jun 26 05:46:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:52 devstack sudo[99375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.info
Jun 26 05:46:52 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:53 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.info" returned: 0 in 0.666s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:53 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Acquiring lock "cinder-quobyte-c5efb5da-e101-48a3-a44e-f750be329a58" by "_copy_volume_from_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:46:53 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Lock "cinder-quobyte-c5efb5da-e101-48a3-a44e-f750be329a58" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:46:53 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] snapshot: 11c47469-d0ca-4484-bc8b-51778e3e36c3, volume: c5efb5da-e101-48a3-a44e-f750be329a58,  {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 05:46:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:46:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:46:53 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:46:53 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:46:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:46:53 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa111d3-1e07-4de2-9129-64be4804f80b]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:46:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:53 devstack sudo[99379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3
Jun 26 05:46:53 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:54 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3" returned: 0 in 0.779s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:46:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 05:46:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Creating direct copy from snapshot {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 05:46:54 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[2150c278-520b-4156-bf1f-d0a5f1acc502]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:46:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:54 devstack sudo[99384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8
Jun 26 05:46:54 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:46:55 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root
Jun 26 05:46:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8" returned: 0 in 0.774s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:46:55 devstack cinder-volume[93708]: DEBUG cinder.utils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Path /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5efb5da-e101-48a3-a44e-f750be329a58 not found in is_blk_device check {{(pid=93708) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 05:46:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5efb5da-e101-48a3-a44e-f750be329a58 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:46:55 devstack sudo[99389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5efb5da-e101-48a3-a44e-f750be329a58
Jun 26 05:46:55 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:01 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5efb5da-e101-48a3-a44e-f750be329a58" returned: 0 in 6.362s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:01 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[008cb6f5-48ea-4091-b12b-ed28db91d2ba]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:01 devstack sudo[99462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8
Jun 26 05:47:01 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:02 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8" returned: 0 in 1.034s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:02 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Image conversion details: src /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5efb5da-e101-48a3-a44e-f750be329a58 {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 05:47:02 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Converted 1024.00 MB image at 160.91 MB/s
Jun 26 05:47:02 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5efb5da-e101-48a3-a44e-f750be329a58 is being set with open permissions: ugo+rw
Jun 26 05:47:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5efb5da-e101-48a3-a44e-f750be329a58 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:02 devstack sudo[99475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5efb5da-e101-48a3-a44e-f750be329a58
Jun 26 05:47:02 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:03 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5efb5da-e101-48a3-a44e-f750be329a58" returned: 0 in 0.778s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:03 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Lock "cinder-quobyte-c5efb5da-e101-48a3-a44e-f750be329a58" released by "_copy_volume_from_snapshot" :: held 9.837s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:03 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Acquiring lock "cinder-quobyte-11c47469-d0ca-4484-bc8b-51778e3e36c3" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:47:03 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Lock "cinder-quobyte-11c47469-d0ca-4484-bc8b-51778e3e36c3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:47:03 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Deleting offline snapshot 11c47469-d0ca-4484-bc8b-51778e3e36c3 of volume 2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:47:03 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] snapshot_file for this snap is: volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:47:03 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7448fb-938b-4282-8e71-bdc6bd45592d]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:03 devstack sudo[99478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3
Jun 26 05:47:03 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:04 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3" returned: 0 in 0.852s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:04 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:47:04 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f449739-d5a5-488b-8e7a-968d5823adac]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:04 devstack sudo[99487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8
Jun 26 05:47:04 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-949f2c66-27a4-468c-b47d-47a52a691406 req-3deb32bf-ae52-4ef3-8e99-bef6cd42688c tempest-TaggedAttachmentsTest-1544346299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:05 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8" returned: 0 in 0.834s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:05 devstack sudo[99501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3
Jun 26 05:47:05 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:05 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3" returned: 0 in 0.837s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:05 devstack sudo[99506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3
Jun 26 05:47:05 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:06 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8.11c47469-d0ca-4484-bc8b-51778e3e36c3" returned: 0 in 0.676s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Lock "cinder-quobyte-11c47469-d0ca-4484-bc8b-51778e3e36c3" released by "_delete_snapshot" :: held 3.313s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.173s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.296s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a6103800-1c50-4b3d-b335-ac39fd80f8f6,created_at=2026-06-26T03:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1245720231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a6103800-1c50-4b3d-b335-ac39fd80f8f6,host='devstack@QuobyteHD#QuobyteHD',id=168a7d60-1266-4e12-a835-2249789d9175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1cce988abe42d0a11308def29a3a67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:46:50Z,use_quota=True,user_id='cdbb601bdb8d43638e33d79778eb4210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91ade78b-3fcd-46d2-ab6c-8184897cfd33),volume_type_id=91ade78b-3fcd-46d2-ab6c-8184897cfd33)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:47:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Creating volume 168a7d60-1266-4e12-a835-2249789d9175 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:47:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:47:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:47:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:47:06 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:47:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:06 devstack sudo[99509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175 1073741824
Jun 26 05:47:06 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:06 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f001299-bafb-41ee-9468-bdd6c7a02fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5efb5da-e101-48a3-a44e-f750be329a58', 'volume_size': 1, 'source_volid': '2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8', 'source_volstatus': 'available'}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:06 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975a6ab0-ed91-4eb7-a117-ac5460be1551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:06 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Volume volume-c5efb5da-e101-48a3-a44e-f750be329a58 (c5efb5da-e101-48a3-a44e-f750be329a58): created successfully
Jun 26 05:47:06 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975a6ab0-ed91-4eb7-a117-ac5460be1551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:06 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Flow 'volume_create_manager' (2cab46ac-f686-4614-b457-de9120dc70eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:47:06 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-289e6676-cec4-45c1-8cf5-f8a839e88291 tempest-VolumesGetTest-148372371 None] Created volume successfully.
Jun 26 05:47:07 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175 1073741824" returned: 0 in 0.952s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:07 devstack sudo[99515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175
Jun 26 05:47:07 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Flow 'volume_create_manager' (66feabe6-a2dd-4a6b-850b-b9385e123e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36ec993-39c6-4cf4-923e-09c10022b9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36ec993-39c6-4cf4-923e-09c10022b9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:47:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-907550261',display_name='tempest-VolumesGetTest-Volume-2115816181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ad6593-123c-4917-b647-cae5be1161a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61bd0850eed745969efac1e96f945ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:47:08Z,use_quota=True,user_id='38a474fa144f4b929a97b0c0d9219eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5f7f38-7da5-4177-8dd2-93d72e0fdd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5f7f38-7da5-4177-8dd2-93d72e0fdd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb077c8-642d-4678-b443-1c4d94640989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb077c8-642d-4678-b443-1c4d94640989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5ad6593-123c-4917-b647-cae5be1161a0', 'volume_name': 'volume-c5ad6593-123c-4917-b647-cae5be1161a0', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5ccf3d-2406-4e42-b43d-c9914d7ae6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5ccf3d-2406-4e42-b43d-c9914d7ae6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a23ed3-6fee-4a18-a5db-84e92d90a956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:08 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Volume c5ad6593-123c-4917-b647-cae5be1161a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5ad6593-123c-4917-b647-cae5be1161a0', 'volume_size': 1}
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:08 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175" returned: 0 in 0.886s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.894s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-949f2c66-27a4-468c-b47d-47a52a691406 req-3deb32bf-ae52-4ef3-8e99-bef6cd42688c tempest-TaggedAttachmentsTest-1544346299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.909s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc03ed0-d8f1-4f7c-9074-ac7d76868b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-168a7d60-1266-4e12-a835-2249789d9175', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060870fd-6207-41d6-a370-54c97f577510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a0e3e8-93b0-4c3a-9c7f-c52c49da0f8d]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-949f2c66-27a4-468c-b47d-47a52a691406 req-3deb32bf-ae52-4ef3-8e99-bef6cd42688c tempest-TaggedAttachmentsTest-1544346299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b729236-b910-4005-b309-e367d657b897 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:08 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Volume volume-168a7d60-1266-4e12-a835-2249789d9175 (168a7d60-1266-4e12-a835-2249789d9175): created successfully
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060870fd-6207-41d6-a370-54c97f577510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Flow 'volume_create_manager' (c02b9e36-b03f-48ac-a8e9-2ba206d0f764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:47:08 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-5cc65a75-e194-42bc-a644-a09d5ac37560 tempest-GroupSnapshotsTest-1228317765 None] Created volume successfully.
Jun 26 05:47:08 devstack sudo[99519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b729236-b910-4005-b309-e367d657b897
Jun 26 05:47:08 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:09 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-949f2c66-27a4-468c-b47d-47a52a691406 req-3deb32bf-ae52-4ef3-8e99-bef6cd42688c tempest-TaggedAttachmentsTest-1544346299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b729236-b910-4005-b309-e367d657b897" returned: 0 in 0.804s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-949f2c66-27a4-468c-b47d-47a52a691406 req-3deb32bf-ae52-4ef3-8e99-bef6cd42688c tempest-TaggedAttachmentsTest-1544346299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.837s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.894s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:47:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-907550261',display_name='tempest-VolumesGetTest-Volume-2115816181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ad6593-123c-4917-b647-cae5be1161a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61bd0850eed745969efac1e96f945ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:47:08Z,use_quota=True,user_id='38a474fa144f4b929a97b0c0d9219eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:47:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Creating volume c5ad6593-123c-4917-b647-cae5be1161a0 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:47:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:47:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:47:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:47:09 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:47:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5ad6593-123c-4917-b647-cae5be1161a0 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:09 devstack sudo[99525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5ad6593-123c-4917-b647-cae5be1161a0 1073741824
Jun 26 05:47:09 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-949f2c66-27a4-468c-b47d-47a52a691406 req-3deb32bf-ae52-4ef3-8e99-bef6cd42688c tempest-TaggedAttachmentsTest-1544346299 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85', 'name': 'volume-5b729236-b910-4005-b309-e367d657b897', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d76656e-bb64-42b2-9210-b53beb0431c2', 'enforce_multipath': True} {{(pid=93708) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 05:47:09 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-949f2c66-27a4-468c-b47d-47a52a691406 req-3deb32bf-ae52-4ef3-8e99-bef6cd42688c tempest-TaggedAttachmentsTest-1544346299 None] attachment_update completed successfully.
Jun 26 05:47:09 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-754bcf20-0710-4b8b-b3da-b2ab35bd21cb tempest-GroupSnapshotsTest-1228317765 None] Update group completed successfully.
Jun 26 05:47:10 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5ad6593-123c-4917-b647-cae5be1161a0 1073741824" returned: 0 in 1.004s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5ad6593-123c-4917-b647-cae5be1161a0 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:10 devstack sudo[99599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5ad6593-123c-4917-b647-cae5be1161a0
Jun 26 05:47:10 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:47:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:47:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:47:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:10 devstack sudo[99918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:47:10 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:11 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5ad6593-123c-4917-b647-cae5be1161a0" returned: 0 in 0.938s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] <== create_volume: return (1996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:47:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a23ed3-6fee-4a18-a5db-84e92d90a956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5ad6593-123c-4917-b647-cae5be1161a0', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1462050a-29ed-4b5d-a3a7-e13235c6e25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:11 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-51a5d984-a910-4289-b219-7a552df4def8 tempest-GroupSnapshotsTest-1228317765 None] Update group completed successfully.
Jun 26 05:47:11 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Volume volume-c5ad6593-123c-4917-b647-cae5be1161a0 (c5ad6593-123c-4917-b647-cae5be1161a0): created successfully
Jun 26 05:47:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1462050a-29ed-4b5d-a3a7-e13235c6e25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Flow 'volume_create_manager' (66feabe6-a2dd-4a6b-850b-b9385e123e88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:47:11 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-ccea8830-45bf-4f75-9f8b-1b30c98e9fe3 tempest-VolumesGetTest-148372371 None] Created volume successfully.
Jun 26 05:47:11 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.972s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:11 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:47:11 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:47:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 8 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:47:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:47:12 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-932dc9d6-4d3d-41cc-acd3-03bc82e45f0f tempest-GroupSnapshotsTest-1228317765 None] Update group completed successfully.
Jun 26 05:47:12 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-472740fb-432e-4f2c-86a4-f2619bc628c3 tempest-VolumesGetTest-148372371 None] Acquiring lock "cinder-c5ad6593-123c-4917-b647-cae5be1161a0-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:47:12 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-472740fb-432e-4f2c-86a4-f2619bc628c3 tempest-VolumesGetTest-148372371 None] Lock "cinder-c5ad6593-123c-4917-b647-cae5be1161a0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:47:12 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-472740fb-432e-4f2c-86a4-f2619bc628c3 tempest-VolumesGetTest-148372371 None] Acquiring lock "cinder-quobyte-c5ad6593-123c-4917-b647-cae5be1161a0" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:47:12 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-472740fb-432e-4f2c-86a4-f2619bc628c3 tempest-VolumesGetTest-148372371 None] Lock "cinder-quobyte-c5ad6593-123c-4917-b647-cae5be1161a0" acquired by "delete_volume" :: waited 0.017s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:47:12 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec0dca2-9586-4151-868f-5709f1cc82aa]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-472740fb-432e-4f2c-86a4-f2619bc628c3 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5ad6593-123c-4917-b647-cae5be1161a0 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:12 devstack sudo[99924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5ad6593-123c-4917-b647-cae5be1161a0
Jun 26 05:47:12 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:13 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-472740fb-432e-4f2c-86a4-f2619bc628c3 tempest-VolumesGetTest-148372371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5ad6593-123c-4917-b647-cae5be1161a0" returned: 0 in 0.781s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-472740fb-432e-4f2c-86a4-f2619bc628c3 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5ad6593-123c-4917-b647-cae5be1161a0 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:13 devstack sudo[99929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5ad6593-123c-4917-b647-cae5be1161a0
Jun 26 05:47:13 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:13 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-12455b86-6dff-4950-bd72-0613c6365b9b tempest-GroupSnapshotsTest-1228317765 None] Update group completed successfully.
Jun 26 05:47:14 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-472740fb-432e-4f2c-86a4-f2619bc628c3 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5ad6593-123c-4917-b647-cae5be1161a0" returned: 0 in 0.738s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-472740fb-432e-4f2c-86a4-f2619bc628c3 tempest-VolumesGetTest-148372371 None] Lock "cinder-quobyte-c5ad6593-123c-4917-b647-cae5be1161a0" released by "delete_volume" :: held 1.569s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:14 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-472740fb-432e-4f2c-86a4-f2619bc628c3 tempest-VolumesGetTest-148372371 None] Created reservations ['6d220f45-36ec-47fb-8d27-033bc0b0b4d6', '587c85a5-1dee-4c64-a3ae-c5a95cf74ffb', 'bbf92591-bf4d-4ec1-86c0-d91339af51e2', '77fedcab-0ac9-4cf0-86c4-0ab6314892b4'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:47:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-472740fb-432e-4f2c-86a4-f2619bc628c3 tempest-VolumesGetTest-148372371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-472740fb-432e-4f2c-86a4-f2619bc628c3 tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-472740fb-432e-4f2c-86a4-f2619bc628c3 tempest-VolumesGetTest-148372371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:47:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-472740fb-432e-4f2c-86a4-f2619bc628c3 tempest-VolumesGetTest-148372371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:47:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-472740fb-432e-4f2c-86a4-f2619bc628c3 tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-472740fb-432e-4f2c-86a4-f2619bc628c3 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:14 devstack sudo[99936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:47:14 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:15 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2da6c654-670d-4b03-a161-f330e654652f tempest-VolumesGetTest-148372371 None] Acquiring lock "cinder-c5efb5da-e101-48a3-a44e-f750be329a58-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:47:15 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2da6c654-670d-4b03-a161-f330e654652f tempest-VolumesGetTest-148372371 None] Lock "cinder-c5efb5da-e101-48a3-a44e-f750be329a58-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:47:15 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2da6c654-670d-4b03-a161-f330e654652f tempest-VolumesGetTest-148372371 None] Acquiring lock "cinder-quobyte-c5efb5da-e101-48a3-a44e-f750be329a58" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:47:15 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2da6c654-670d-4b03-a161-f330e654652f tempest-VolumesGetTest-148372371 None] Lock "cinder-quobyte-c5efb5da-e101-48a3-a44e-f750be329a58" acquired by "delete_volume" :: waited 0.020s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:47:15 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] GroupSnapshot 955c8751-91b9-439d-9f36-d6f6fdc0f011: creating.
Jun 26 05:47:15 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80ad5c6-a4f3-46de-ba7c-8c5efaac779f]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2da6c654-670d-4b03-a161-f330e654652f tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5efb5da-e101-48a3-a44e-f750be329a58 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:15 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] Group snapshot 955c8751-91b9-439d-9f36-d6f6fdc0f011: creating. {{(pid=93708) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 26 05:47:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:15 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-472740fb-432e-4f2c-86a4-f2619bc628c3 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.136s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:15 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-472740fb-432e-4f2c-86a4-f2619bc628c3 tempest-VolumesGetTest-148372371 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:47:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] Creating offline snapshot 89367002-76b2-467c-99d9-a1d7dbff68e2 of volume 168a7d60-1266-4e12-a835-2249789d9175 {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:47:15 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-472740fb-432e-4f2c-86a4-f2619bc628c3 tempest-VolumesGetTest-148372371 None] Deleted volume successfully.
Jun 26 05:47:15 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8df958-ebe0-411b-a617-46245bf1c99c]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:15 devstack sudo[99940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5efb5da-e101-48a3-a44e-f750be329a58
Jun 26 05:47:15 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:15 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-472740fb-432e-4f2c-86a4-f2619bc628c3 tempest-VolumesGetTest-148372371 None] Lock "cinder-c5ad6593-123c-4917-b647-cae5be1161a0-delete_volume" released by "delete_volume" :: held 3.024s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:15 devstack sudo[99942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175
Jun 26 05:47:15 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:16 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2da6c654-670d-4b03-a161-f330e654652f tempest-VolumesGetTest-148372371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5efb5da-e101-48a3-a44e-f750be329a58" returned: 0 in 0.845s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2da6c654-670d-4b03-a161-f330e654652f tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5efb5da-e101-48a3-a44e-f750be329a58 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:16 devstack sudo[99948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5efb5da-e101-48a3-a44e-f750be329a58
Jun 26 05:47:16 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:16 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175" returned: 0 in 0.894s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.89367002-76b2-467c-99d9-a1d7dbff68e2 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:16 devstack sudo[99953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.89367002-76b2-467c-99d9-a1d7dbff68e2 1G
Jun 26 05:47:16 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:17 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2da6c654-670d-4b03-a161-f330e654652f tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5efb5da-e101-48a3-a44e-f750be329a58" returned: 0 in 0.772s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2da6c654-670d-4b03-a161-f330e654652f tempest-VolumesGetTest-148372371 None] Lock "cinder-quobyte-c5efb5da-e101-48a3-a44e-f750be329a58" released by "delete_volume" :: held 1.711s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:17 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-2da6c654-670d-4b03-a161-f330e654652f tempest-VolumesGetTest-148372371 None] Created reservations ['fb6f7a5e-3d21-4063-a081-953514ce7999', '475ad281-6dd7-4360-aa74-526d2a765aa6', '0c38a317-7ff8-430b-86ee-9502ca35a2a8', '68439b47-48aa-43ec-b2fa-a4c68fc6cbd0'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:47:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2da6c654-670d-4b03-a161-f330e654652f tempest-VolumesGetTest-148372371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2da6c654-670d-4b03-a161-f330e654652f tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:17 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2da6c654-670d-4b03-a161-f330e654652f tempest-VolumesGetTest-148372371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:47:17 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2da6c654-670d-4b03-a161-f330e654652f tempest-VolumesGetTest-148372371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:47:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2da6c654-670d-4b03-a161-f330e654652f tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2da6c654-670d-4b03-a161-f330e654652f tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:17 devstack sudo[99963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:47:17 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:17 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-1786d528-a050-4af6-b278-ad797373d542 req-bb20ca48-2fe4-4298-bcac-2ade8faadbc8 tempest-TaggedAttachmentsTest-1544346299 None] Terminate volume connection completed successfully.
Jun 26 05:47:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-1786d528-a050-4af6-b278-ad797373d542 req-bb20ca48-2fe4-4298-bcac-2ade8faadbc8 tempest-TaggedAttachmentsTest-1544346299 None] Deleting attachment 9d76656e-bb64-42b2-9210-b53beb0431c2. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 05:47:17 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.89367002-76b2-467c-99d9-a1d7dbff68e2 1G" returned: 0 in 1.089s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-168a7d60-1266-4e12-a835-2249789d9175 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.89367002-76b2-467c-99d9-a1d7dbff68e2 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:17 devstack sudo[99993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-168a7d60-1266-4e12-a835-2249789d9175 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.89367002-76b2-467c-99d9-a1d7dbff68e2
Jun 26 05:47:17 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fce47f5b-b85a-4ee9-b122-0d5177e87b7f tempest-VolumesGetTest-148372371 None] Acquiring lock "cinder-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:47:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fce47f5b-b85a-4ee9-b122-0d5177e87b7f tempest-VolumesGetTest-148372371 None] Lock "cinder-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:47:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fce47f5b-b85a-4ee9-b122-0d5177e87b7f tempest-VolumesGetTest-148372371 None] Acquiring lock "cinder-quobyte-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:47:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fce47f5b-b85a-4ee9-b122-0d5177e87b7f tempest-VolumesGetTest-148372371 None] Lock "cinder-quobyte-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8" acquired by "delete_volume" :: waited 0.024s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:47:17 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0058554-e0eb-4ee7-ac98-e941ebdb98c7]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fce47f5b-b85a-4ee9-b122-0d5177e87b7f tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:18 devstack sudo[99995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8
Jun 26 05:47:18 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:18 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2da6c654-670d-4b03-a161-f330e654652f tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.998s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:18 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-2da6c654-670d-4b03-a161-f330e654652f tempest-VolumesGetTest-148372371 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:47:18 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-2da6c654-670d-4b03-a161-f330e654652f tempest-VolumesGetTest-148372371 None] Deleted volume successfully.
Jun 26 05:47:18 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2da6c654-670d-4b03-a161-f330e654652f tempest-VolumesGetTest-148372371 None] Lock "cinder-c5efb5da-e101-48a3-a44e-f750be329a58-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:18 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-168a7d60-1266-4e12-a835-2249789d9175 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.89367002-76b2-467c-99d9-a1d7dbff68e2" returned: 0 in 0.916s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:18 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.89367002-76b2-467c-99d9-a1d7dbff68e2 is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 05:47:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.89367002-76b2-467c-99d9-a1d7dbff68e2 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:18 devstack sudo[100002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.89367002-76b2-467c-99d9-a1d7dbff68e2
Jun 26 05:47:18 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:18 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fce47f5b-b85a-4ee9-b122-0d5177e87b7f tempest-VolumesGetTest-148372371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8" returned: 0 in 0.897s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fce47f5b-b85a-4ee9-b122-0d5177e87b7f tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:18 devstack sudo[100007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8
Jun 26 05:47:18 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:19 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.89367002-76b2-467c-99d9-a1d7dbff68e2" returned: 0 in 0.756s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:19 devstack sudo[100012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.info
Jun 26 05:47:19 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:19 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fce47f5b-b85a-4ee9-b122-0d5177e87b7f tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8" returned: 0 in 0.726s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fce47f5b-b85a-4ee9-b122-0d5177e87b7f tempest-VolumesGetTest-148372371 None] Lock "cinder-quobyte-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8" released by "delete_volume" :: held 1.718s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:19 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-fce47f5b-b85a-4ee9-b122-0d5177e87b7f tempest-VolumesGetTest-148372371 None] Created reservations ['4c04bdb8-99fe-4a1b-8949-dd5d5691cdd8', '0d31b6db-2cfe-4748-bf27-b01db97ab941', '28f4b048-5881-43cd-bbc2-36dde17c6159', '810f8045-618b-4b1d-9ebe-9dc13998027a'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:47:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fce47f5b-b85a-4ee9-b122-0d5177e87b7f tempest-VolumesGetTest-148372371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fce47f5b-b85a-4ee9-b122-0d5177e87b7f tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:19 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-fce47f5b-b85a-4ee9-b122-0d5177e87b7f tempest-VolumesGetTest-148372371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:47:19 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-fce47f5b-b85a-4ee9-b122-0d5177e87b7f tempest-VolumesGetTest-148372371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:47:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fce47f5b-b85a-4ee9-b122-0d5177e87b7f tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fce47f5b-b85a-4ee9-b122-0d5177e87b7f tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:19 devstack sudo[100017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:47:19 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:20 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.info" returned: 0 in 0.938s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:20 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 05:47:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:20 devstack sudo[100020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.info
Jun 26 05:47:20 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:20 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fce47f5b-b85a-4ee9-b122-0d5177e87b7f tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.767s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:20 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-fce47f5b-b85a-4ee9-b122-0d5177e87b7f tempest-VolumesGetTest-148372371 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:47:20 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-fce47f5b-b85a-4ee9-b122-0d5177e87b7f tempest-VolumesGetTest-148372371 None] Deleted volume successfully.
Jun 26 05:47:20 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fce47f5b-b85a-4ee9-b122-0d5177e87b7f tempest-VolumesGetTest-148372371 None] Lock "cinder-2cfe4fe0-aa2a-42e2-a3b5-8cd0724e51e8-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:21 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.info" returned: 0 in 0.779s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.578s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] Creating offline snapshot e728e5cb-cf90-4ba1-af0c-4645cfca4e25 of volume c15865b7-8642-41f2-bfcd-d63cc8a3eed1 {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:47:21 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f0488d-aa2b-4ee8-bf51-6256a27d9ce3]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:21 devstack sudo[100039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1
Jun 26 05:47:21 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:21 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:47:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Flow 'volume_create_manager' (8cb55339-d406-4182-be87-1d2e8c16ef5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:47:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d850e746-b768-43ab-83cd-f75600a8a651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d850e746-b768-43ab-83cd-f75600a8a651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1758569051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f6c603-0a82-47a0-b923-83960a13302d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='61bd0850eed745969efac1e96f945ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:47:22Z,use_quota=True,user_id='38a474fa144f4b929a97b0c0d9219eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc49366d-c26c-4d7e-b09c-f5f3064367af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc49366d-c26c-4d7e-b09c-f5f3064367af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5218641c-c6ea-444b-aad7-8ec65adc52ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:21 devstack cinder-volume[93708]: DEBUG cinder.image.glance [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Creating Keystone auth plugin from conf {{(pid=93708) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 26 05:47:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5218641c-c6ea-444b-aad7-8ec65adc52ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '97f6c603-0a82-47a0-b923-83960a13302d', 'volume_name': 'volume-97f6c603-0a82-47a0-b923-83960a13302d', 'volume_size': 1, 'image_id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '672660d1b01a45828d72fce38b12f1f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'created_at': datetime.datetime(2026, 6, 26, 3, 35, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 3, 35, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfc393ae-7412-4258-bda5-dc0a6732fb07/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf43dbd4c0>}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e5f74e-8cac-483b-9d4f-f4b4cf75e89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e5f74e-8cac-483b-9d4f-f4b4cf75e89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373e70f5-b024-4cdb-8819-15c7401b0efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:22 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Volume 97f6c603-0a82-47a0-b923-83960a13302d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-97f6c603-0a82-47a0-b923-83960a13302d', 'volume_size': 1, 'image_id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '672660d1b01a45828d72fce38b12f1f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'created_at': datetime.datetime(2026, 6, 26, 3, 35, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 3, 35, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfc393ae-7412-4258-bda5-dc0a6732fb07/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf43dbd4c0>}
Jun 26 05:47:22 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Trying to clone 97f6c603-0a82-47a0-b923-83960a13302d from image dfc393ae-7412-4258-bda5-dc0a6732fb07 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}]). {{(pid=93708) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 26 05:47:22 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1" returned: 0 in 1.200s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.e728e5cb-cf90-4ba1-af0c-4645cfca4e25 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:22 devstack sudo[100085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.e728e5cb-cf90-4ba1-af0c-4645cfca4e25 1G
Jun 26 05:47:22 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:22 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_ij2vf68qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 26 05:47:22 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Image download 20.69 MB at 20.69 MB/s
Jun 26 05:47:23 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[764dd9ed-a13d-497e-826a-65b2d9718175]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_ij2vf68qdevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:23 devstack sudo[100110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_ij2vf68qdevstack@QuobyteHD
Jun 26 05:47:23 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:23 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.e728e5cb-cf90-4ba1-af0c-4645cfca4e25 1G" returned: 0 in 0.851s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.e728e5cb-cf90-4ba1-af0c-4645cfca4e25 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:23 devstack sudo[100115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.e728e5cb-cf90-4ba1-af0c-4645cfca4e25
Jun 26 05:47:23 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:23 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_ij2vf68qdevstack@QuobyteHD" returned: 0 in 0.811s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:23 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Temporary image dfc393ae-7412-4258-bda5-dc0a6732fb07 is fetched for user 38a474fa144f4b929a97b0c0d9219eab. {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 26 05:47:23 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=92,cinder:UPDATE=106,cinder:DELETE=5,cinder:INSERT=26 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:47:23 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[298fac6d-0086-4b3d-9276-c1b392e1283f]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_ij2vf68qdevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:24 devstack sudo[100120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_ij2vf68qdevstack@QuobyteHD
Jun 26 05:47:24 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:24 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.e728e5cb-cf90-4ba1-af0c-4645cfca4e25" returned: 0 in 0.852s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:24 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.e728e5cb-cf90-4ba1-af0c-4645cfca4e25 is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 05:47:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.e728e5cb-cf90-4ba1-af0c-4645cfca4e25 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:24 devstack sudo[100125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.e728e5cb-cf90-4ba1-af0c-4645cfca4e25
Jun 26 05:47:24 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:24 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_ij2vf68qdevstack@QuobyteHD" returned: 0 in 0.785s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:24 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.e728e5cb-cf90-4ba1-af0c-4645cfca4e25" returned: 0 in 0.673s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:25 devstack sudo[100131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.info
Jun 26 05:47:25 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:25 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.info" returned: 0 in 0.675s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:25 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 05:47:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:25 devstack sudo[100134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.info
Jun 26 05:47:25 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:26 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.info" returned: 0 in 0.786s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.212s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.751s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1758569051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f6c603-0a82-47a0-b923-83960a13302d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='61bd0850eed745969efac1e96f945ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:47:22Z,use_quota=True,user_id='38a474fa144f4b929a97b0c0d9219eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:47:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Creating volume 97f6c603-0a82-47a0-b923-83960a13302d {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:47:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:47:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:47:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:47:26 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:47:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:26 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=109,cinder:SELECT=99,cinder:INSERT=24,cinder:DELETE=8 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:47:26 devstack sudo[100137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d 1073741824
Jun 26 05:47:26 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:26 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-1ae08e6f-16be-4018-9a14-5ba505ce9c2f tempest-GroupSnapshotsTest-1228317765 None] group_snapshot 955c8751-91b9-439d-9f36-d6f6fdc0f011: created successfully
Jun 26 05:47:27 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] group_snapshot 955c8751-91b9-439d-9f36-d6f6fdc0f011: deleting
Jun 26 05:47:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] group_snapshot 955c8751-91b9-439d-9f36-d6f6fdc0f011: deleting {{(pid=93708) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 26 05:47:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "cinder-quobyte-168a7d60-1266-4e12-a835-2249789d9175" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:47:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-168a7d60-1266-4e12-a835-2249789d9175" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:47:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "cinder-quobyte-89367002-76b2-467c-99d9-a1d7dbff68e2" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:47:27 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-89367002-76b2-467c-99d9-a1d7dbff68e2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:47:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Deleting offline snapshot 89367002-76b2-467c-99d9-a1d7dbff68e2 of volume 168a7d60-1266-4e12-a835-2249789d9175 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:47:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] snapshot_file for this snap is: volume-168a7d60-1266-4e12-a835-2249789d9175.89367002-76b2-467c-99d9-a1d7dbff68e2 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:47:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d 1073741824" returned: 0 in 1.226s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:27 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d9a3ab-8870-427d-9337-7f520060c0a4]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.89367002-76b2-467c-99d9-a1d7dbff68e2 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:27 devstack sudo[100158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d
Jun 26 05:47:27 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:27 devstack sudo[100157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.89367002-76b2-467c-99d9-a1d7dbff68e2
Jun 26 05:47:27 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:28 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d" returned: 0 in 1.133s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] <== create_volume: return (2432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:47:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.435s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:28 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Attempting download of dfc393ae-7412-4258-bda5-dc0a6732fb07 ((None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}])) to volume 97f6c603-0a82-47a0-b923-83960a13302d. {{(pid=93708) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 26 05:47:28 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.89367002-76b2-467c-99d9-a1d7dbff68e2" returned: 0 in 1.252s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-168a7d60-1266-4e12-a835-2249789d9175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:47:29 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6583ce8-7ee1-4872-a4b1-8cea4b14932e]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:29 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1206cdb-76da-4ccc-af33-5e41fc7bd50d]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_w_u1u8jp {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:29 devstack sudo[100214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175
Jun 26 05:47:29 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:29 devstack sudo[100215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_w_u1u8jp
Jun 26 05:47:29 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:29 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_w_u1u8jp" returned: 0 in 0.770s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_w_u1u8jp {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:29 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175" returned: 0 in 0.847s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.89367002-76b2-467c-99d9-a1d7dbff68e2 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:29 devstack sudo[100225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.89367002-76b2-467c-99d9-a1d7dbff68e2
Jun 26 05:47:29 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:29 devstack sudo[100224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_w_u1u8jp
Jun 26 05:47:29 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:30 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_w_u1u8jp" returned: 1 in 0.887s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_w_u1u8jp' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 05:47:30 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f21863-b06d-4c72-950a-5bcda6804108]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_ij2vf68qdevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:30 devstack sudo[100235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_ij2vf68qdevstack@QuobyteHD
Jun 26 05:47:30 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:30 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.89367002-76b2-467c-99d9-a1d7dbff68e2" returned: 0 in 0.970s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.89367002-76b2-467c-99d9-a1d7dbff68e2 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:30 devstack sudo[100237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.89367002-76b2-467c-99d9-a1d7dbff68e2
Jun 26 05:47:30 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:31 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_ij2vf68qdevstack@QuobyteHD" returned: 0 in 0.791s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:31 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] dfc393ae-7412-4258-bda5-dc0a6732fb07 was qcow2, converting to raw {{(pid=93708) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 26 05:47:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_ij2vf68qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:31 devstack sudo[100248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_ij2vf68qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d
Jun 26 05:47:31 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:31 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175.89367002-76b2-467c-99d9-a1d7dbff68e2" returned: 0 in 0.733s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-89367002-76b2-467c-99d9-a1d7dbff68e2" released by "_delete_snapshot" :: held 3.959s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-168a7d60-1266-4e12-a835-2249789d9175" released by "delete_snapshot" :: held 3.989s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "cinder-quobyte-c15865b7-8642-41f2-bfcd-d63cc8a3eed1" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:47:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-c15865b7-8642-41f2-bfcd-d63cc8a3eed1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:47:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "cinder-quobyte-e728e5cb-cf90-4ba1-af0c-4645cfca4e25" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:47:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-e728e5cb-cf90-4ba1-af0c-4645cfca4e25" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:47:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Deleting offline snapshot e728e5cb-cf90-4ba1-af0c-4645cfca4e25 of volume c15865b7-8642-41f2-bfcd-d63cc8a3eed1 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:47:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] snapshot_file for this snap is: volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.e728e5cb-cf90-4ba1-af0c-4645cfca4e25 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:47:31 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[effaff9a-6aa8-44a7-b802-6b2b83946eb6]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.e728e5cb-cf90-4ba1-af0c-4645cfca4e25 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:31 devstack sudo[100250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.e728e5cb-cf90-4ba1-af0c-4645cfca4e25
Jun 26 05:47:31 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:32 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.e728e5cb-cf90-4ba1-af0c-4645cfca4e25" returned: 0 in 0.851s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:32 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:47:32 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f43e84-03eb-4c9e-ba86-cf481bd04748]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:32 devstack sudo[100265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1
Jun 26 05:47:32 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:33 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1" returned: 0 in 1.272s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.e728e5cb-cf90-4ba1-af0c-4645cfca4e25 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:33 devstack sudo[100337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.e728e5cb-cf90-4ba1-af0c-4645cfca4e25
Jun 26 05:47:33 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:34 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_ij2vf68qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d" returned: 0 in 2.688s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:34 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_ij2vf68qdevstack@QuobyteHD, size 112.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 05:47:34 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Converted 112.00 MB image at 41.63 MB/s
Jun 26 05:47:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:34 devstack sudo[100344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d 1G
Jun 26 05:47:34 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:34 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.e728e5cb-cf90-4ba1-af0c-4645cfca4e25" returned: 0 in 0.997s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.e728e5cb-cf90-4ba1-af0c-4645cfca4e25 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:34 devstack sudo[100356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.e728e5cb-cf90-4ba1-af0c-4645cfca4e25
Jun 26 05:47:34 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:35 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d 1G" returned: 0 in 1.062s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:35 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[36efaa9d-4e93-48e8-802e-d65f97a5b80b]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:35 devstack sudo[100361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d
Jun 26 05:47:35 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:35 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1.e728e5cb-cf90-4ba1-af0c-4645cfca4e25" returned: 0 in 0.986s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-e728e5cb-cf90-4ba1-af0c-4645cfca4e25" released by "_delete_snapshot" :: held 4.263s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-c15865b7-8642-41f2-bfcd-d63cc8a3eed1" released by "delete_snapshot" :: held 4.293s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:36 devstack cinder-volume[93708]: WARNING cinder.quota [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-855996603 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-855996603, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:47:36 devstack cinder-volume[93708]: WARNING cinder.quota [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-855996603 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-855996603, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:47:36 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Created reservations ['21107a35-4d7b-4798-b8d0-90f5495a3b05', '29402d1c-9d4a-4f76-bdc2-b03c873e8a7e', '65128fbb-68eb-4af1-a6f8-c06120bc44a8', '17b373c2-7056-4ec7-8247-bf5ace6fb215'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:47:36 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] Created reservations ['b05a707a-ff36-4548-8d4f-fcb7f531a187', '897297db-c34c-4133-ba69-6756d037de86', '4c515f76-633a-403e-9cd4-f69a56bc5344', 'c79db7e8-0d4b-43b1-a312-006b87d47e87'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:47:36 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-4f940946-26f3-4dc2-ac66-20ae029a5b06 tempest-GroupSnapshotsTest-1228317765 None] group_snapshot 955c8751-91b9-439d-9f36-d6f6fdc0f011: deleted successfully
Jun 26 05:47:36 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d" returned: 0 in 1.226s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:36 devstack sudo[100366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d
Jun 26 05:47:36 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "cinder-quobyte-168a7d60-1266-4e12-a835-2249789d9175" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:47:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-168a7d60-1266-4e12-a835-2249789d9175" acquired by "delete_volume" :: waited 0.024s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:47:37 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[2041cc57-2106-45de-8e95-8af0c06acacd]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:37 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d" returned: 1 in 1.123s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 05:47:37 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Downloaded image dfc393ae-7412-4258-bda5-dc0a6732fb07 ((None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}])) to volume 97f6c603-0a82-47a0-b923-83960a13302d successfully. {{(pid=93708) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 26 05:47:37 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Temporary image dfc393ae-7412-4258-bda5-dc0a6732fb07 for user 38a474fa144f4b929a97b0c0d9219eab is deleted. {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 26 05:47:37 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Marking volume 97f6c603-0a82-47a0-b923-83960a13302d as bootable. {{(pid=93708) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 26 05:47:37 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Copying metadata from image dfc393ae-7412-4258-bda5-dc0a6732fb07 to 97f6c603-0a82-47a0-b923-83960a13302d. {{(pid=93708) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 26 05:47:37 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Creating volume glance metadata for volume 97f6c603-0a82-47a0-b923-83960a13302d backed by image dfc393ae-7412-4258-bda5-dc0a6732fb07 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93708) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 26 05:47:37 devstack sudo[100371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175
Jun 26 05:47:37 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373e70f5-b024-4cdb-8819-15c7401b0efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97f6c603-0a82-47a0-b923-83960a13302d', 'volume_size': 1, 'image_id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '672660d1b01a45828d72fce38b12f1f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'created_at': datetime.datetime(2026, 6, 26, 3, 35, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 3, 35, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfc393ae-7412-4258-bda5-dc0a6732fb07/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf43dbd4c0>}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66218a84-3edd-4c90-91bc-5fe6fb692edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:38 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Volume volume-97f6c603-0a82-47a0-b923-83960a13302d (97f6c603-0a82-47a0-b923-83960a13302d): created successfully
Jun 26 05:47:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66218a84-3edd-4c90-91bc-5fe6fb692edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Flow 'volume_create_manager' (8cb55339-d406-4182-be87-1d2e8c16ef5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:47:38 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-197b2bdf-e500-4811-8872-a5d6813cf1d0 tempest-VolumesGetTest-148372371 None] Created volume successfully.
Jun 26 05:47:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f0d328e4-ba19-424d-bf35-d949a19bd237 tempest-TaggedAttachmentsTest-1544346299 None] Acquiring lock "cinder-5b729236-b910-4005-b309-e367d657b897-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:47:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f0d328e4-ba19-424d-bf35-d949a19bd237 tempest-TaggedAttachmentsTest-1544346299 None] Lock "cinder-5b729236-b910-4005-b309-e367d657b897-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:47:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f0d328e4-ba19-424d-bf35-d949a19bd237 tempest-TaggedAttachmentsTest-1544346299 None] Acquiring lock "cinder-quobyte-5b729236-b910-4005-b309-e367d657b897" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:47:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f0d328e4-ba19-424d-bf35-d949a19bd237 tempest-TaggedAttachmentsTest-1544346299 None] Lock "cinder-quobyte-5b729236-b910-4005-b309-e367d657b897" acquired by "delete_volume" :: waited 0.035s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:47:38 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[0472a009-856b-43c2-872c-1936a59b0b20]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f0d328e4-ba19-424d-bf35-d949a19bd237 tempest-TaggedAttachmentsTest-1544346299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b729236-b910-4005-b309-e367d657b897 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:38 devstack sudo[100374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b729236-b910-4005-b309-e367d657b897
Jun 26 05:47:38 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:38 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175" returned: 0 in 1.318s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:38 devstack sudo[100380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175
Jun 26 05:47:38 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:39 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f0d328e4-ba19-424d-bf35-d949a19bd237 tempest-TaggedAttachmentsTest-1544346299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b729236-b910-4005-b309-e367d657b897" returned: 0 in 1.187s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f0d328e4-ba19-424d-bf35-d949a19bd237 tempest-TaggedAttachmentsTest-1544346299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b729236-b910-4005-b309-e367d657b897 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:39 devstack sudo[100386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b729236-b910-4005-b309-e367d657b897
Jun 26 05:47:39 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:39 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-168a7d60-1266-4e12-a835-2249789d9175" returned: 0 in 0.946s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-168a7d60-1266-4e12-a835-2249789d9175" released by "delete_volume" :: held 2.375s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "cinder-quobyte-c15865b7-8642-41f2-bfcd-d63cc8a3eed1" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:47:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-c15865b7-8642-41f2-bfcd-d63cc8a3eed1" acquired by "delete_volume" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:47:39 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe342b99-a13b-4f5b-8e0d-78db49c8d1c5]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:40 devstack sudo[100390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1
Jun 26 05:47:40 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Flow 'volume_create_manager' (679ef6f3-ee78-4b7c-8400-7a968bc6affc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60fac7ec-69e7-4cf2-a082-6c69983d53bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60fac7ec-69e7-4cf2-a082-6c69983d53bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:47:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-114162319',display_name='tempest-VolumesGetTest-Volume-1683636242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05058b7-0cb7-4749-99ab-c03b08d01430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61bd0850eed745969efac1e96f945ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:47:40Z,use_quota=True,user_id='38a474fa144f4b929a97b0c0d9219eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:40 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ccc15cf-badb-4535-ad78-b8a42449bb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ccc15cf-badb-4535-ad78-b8a42449bb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b88cd93-3ce8-4b85-b3bd-f9d3a824a7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b88cd93-3ce8-4b85-b3bd-f9d3a824a7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b05058b7-0cb7-4749-99ab-c03b08d01430', 'volume_name': 'volume-b05058b7-0cb7-4749-99ab-c03b08d01430', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e435f96-5d81-47c6-84ab-2d32074c12ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e435f96-5d81-47c6-84ab-2d32074c12ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfaec33d-971e-417b-86c2-0c3e147f0756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:40 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Volume b05058b7-0cb7-4749-99ab-c03b08d01430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b05058b7-0cb7-4749-99ab-c03b08d01430', 'volume_size': 1}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:47:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-114162319',display_name='tempest-VolumesGetTest-Volume-1683636242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05058b7-0cb7-4749-99ab-c03b08d01430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61bd0850eed745969efac1e96f945ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:47:40Z,use_quota=True,user_id='38a474fa144f4b929a97b0c0d9219eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Creating volume b05058b7-0cb7-4749-99ab-c03b08d01430 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:47:40 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b05058b7-0cb7-4749-99ab-c03b08d01430 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f0d328e4-ba19-424d-bf35-d949a19bd237 tempest-TaggedAttachmentsTest-1544346299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b729236-b910-4005-b309-e367d657b897" returned: 0 in 1.124s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f0d328e4-ba19-424d-bf35-d949a19bd237 tempest-TaggedAttachmentsTest-1544346299 None] Lock "cinder-quobyte-5b729236-b910-4005-b309-e367d657b897" released by "delete_volume" :: held 2.371s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:40 devstack sudo[100393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b05058b7-0cb7-4749-99ab-c03b08d01430 1073741824
Jun 26 05:47:40 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-f0d328e4-ba19-424d-bf35-d949a19bd237 tempest-TaggedAttachmentsTest-1544346299 None] Created reservations ['a279eee7-f0f3-4991-bda3-206230106755', '211f5e32-b952-4872-91c6-59687ac31d60', '25b17c9d-6959-43b7-9230-98fba1422df2', '15304e38-a182-40b8-bb87-96388bcd59d5'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f0d328e4-ba19-424d-bf35-d949a19bd237 tempest-TaggedAttachmentsTest-1544346299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f0d328e4-ba19-424d-bf35-d949a19bd237 tempest-TaggedAttachmentsTest-1544346299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f0d328e4-ba19-424d-bf35-d949a19bd237 tempest-TaggedAttachmentsTest-1544346299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f0d328e4-ba19-424d-bf35-d949a19bd237 tempest-TaggedAttachmentsTest-1544346299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f0d328e4-ba19-424d-bf35-d949a19bd237 tempest-TaggedAttachmentsTest-1544346299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f0d328e4-ba19-424d-bf35-d949a19bd237 tempest-TaggedAttachmentsTest-1544346299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:40 devstack sudo[100395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:47:40 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:41 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1" returned: 0 in 1.299s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:41 devstack sudo[100401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1
Jun 26 05:47:41 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:41 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f0d328e4-ba19-424d-bf35-d949a19bd237 tempest-TaggedAttachmentsTest-1544346299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.999s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:41 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-f0d328e4-ba19-424d-bf35-d949a19bd237 tempest-TaggedAttachmentsTest-1544346299 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:47:41 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:41 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-f0d328e4-ba19-424d-bf35-d949a19bd237 tempest-TaggedAttachmentsTest-1544346299 None] Deleted volume successfully.
Jun 26 05:47:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b05058b7-0cb7-4749-99ab-c03b08d01430 1073741824" returned: 0 in 1.278s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f0d328e4-ba19-424d-bf35-d949a19bd237 tempest-TaggedAttachmentsTest-1544346299 None] Lock "cinder-5b729236-b910-4005-b309-e367d657b897-delete_volume" released by "delete_volume" :: held 3.736s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b05058b7-0cb7-4749-99ab-c03b08d01430 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:42 devstack sudo[100410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b05058b7-0cb7-4749-99ab-c03b08d01430
Jun 26 05:47:42 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:42 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c15865b7-8642-41f2-bfcd-d63cc8a3eed1" returned: 0 in 0.880s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-c15865b7-8642-41f2-bfcd-d63cc8a3eed1" released by "delete_volume" :: held 2.248s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:42 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Created reservations ['3c7b5f07-0f9b-44d1-8b0d-a42d8e0e5dd8'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:47:42 devstack cinder-volume[93708]: WARNING cinder.quota [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-855996603 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-855996603, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:47:42 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Created reservations ['0bf375ae-c6f0-49a9-9109-e774261a8c76', '63539d35-24b0-4016-84a4-33b581f2ec0d', '7bf4bace-f662-4fe2-82e4-6d6da4581df4', '8b3c7ec7-f5ff-4ed6-aaa9-a70460f3abe7'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:47:42 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Created reservations ['0f356308-c4a2-4e86-ba07-6e307385fba4', 'a8b2bc0a-93c9-41b5-af0f-9032ccd5abf9', '5b2d47fd-c32b-4b2e-a3c7-df6616445181', '9288c78c-9ebe-4d2e-8fd6-c367896506cd'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:47:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:47:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:47:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:42 devstack sudo[100412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:47:42 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:42 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b05058b7-0cb7-4749-99ab-c03b08d01430" returned: 0 in 0.972s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] <== create_volume: return (2310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:47:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.313s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:43 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfaec33d-971e-417b-86c2-0c3e147f0756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b05058b7-0cb7-4749-99ab-c03b08d01430', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:43 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e43988-e002-46ae-a2a0-1c437c3e05ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:43 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Volume volume-b05058b7-0cb7-4749-99ab-c03b08d01430 (b05058b7-0cb7-4749-99ab-c03b08d01430): created successfully
Jun 26 05:47:43 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e43988-e002-46ae-a2a0-1c437c3e05ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:43 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Flow 'volume_create_manager' (679ef6f3-ee78-4b7c-8400-7a968bc6affc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:47:43 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-eebf2c85-80f8-430d-a3c8-4270b1e0adf3 tempest-VolumesGetTest-148372371 None] Created volume successfully.
Jun 26 05:47:43 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-29a9faa6-66e1-4a61-952e-4caa6aa59236 tempest-GroupSnapshotsTest-1228317765 None] Group tempest-GroupSnapshotsTest-Group-1029094656: creating
Jun 26 05:47:43 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-29a9faa6-66e1-4a61-952e-4caa6aa59236 tempest-GroupSnapshotsTest-1228317765 None] Group tempest-GroupSnapshotsTest-Group-1029094656: created successfully
Jun 26 05:47:43 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-29a9faa6-66e1-4a61-952e-4caa6aa59236 tempest-GroupSnapshotsTest-1228317765 None] Create group completed successfully.
Jun 26 05:47:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.146s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:43 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:47:43 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:43 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e30b8652-f5fe-42dd-a8e4-303e8faa3654 tempest-GroupSnapshotsTest-1228317765 None] Delete group completed successfully.
Jun 26 05:47:43 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8649b77b-f72f-4080-a834-e7f42833b7b6 tempest-VolumesGetTest-148372371 None] Acquiring lock "cinder-b05058b7-0cb7-4749-99ab-c03b08d01430-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:47:43 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8649b77b-f72f-4080-a834-e7f42833b7b6 tempest-VolumesGetTest-148372371 None] Lock "cinder-b05058b7-0cb7-4749-99ab-c03b08d01430-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:47:43 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8649b77b-f72f-4080-a834-e7f42833b7b6 tempest-VolumesGetTest-148372371 None] Acquiring lock "cinder-quobyte-b05058b7-0cb7-4749-99ab-c03b08d01430" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:47:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8649b77b-f72f-4080-a834-e7f42833b7b6 tempest-VolumesGetTest-148372371 None] Lock "cinder-quobyte-b05058b7-0cb7-4749-99ab-c03b08d01430" acquired by "delete_volume" :: waited 0.017s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:47:44 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f1f497-163a-4001-95ad-de55c68c4fc2]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8649b77b-f72f-4080-a834-e7f42833b7b6 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b05058b7-0cb7-4749-99ab-c03b08d01430 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:44 devstack sudo[100417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b05058b7-0cb7-4749-99ab-c03b08d01430
Jun 26 05:47:44 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:44 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8649b77b-f72f-4080-a834-e7f42833b7b6 tempest-VolumesGetTest-148372371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b05058b7-0cb7-4749-99ab-c03b08d01430" returned: 0 in 0.898s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8649b77b-f72f-4080-a834-e7f42833b7b6 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b05058b7-0cb7-4749-99ab-c03b08d01430 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:44 devstack sudo[100423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b05058b7-0cb7-4749-99ab-c03b08d01430
Jun 26 05:47:44 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Flow 'volume_create_manager' (1d97181f-e47b-430a-b5bf-6f0afd0f2a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9d5830-ca22-4125-9907-1d020772ef1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9d5830-ca22-4125-9907-1d020772ef1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1870776035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=656fb20d-6108-49ba-91a8-499ad0a20351,host='devstack@QuobyteHD#QuobyteHD',id=c352a16d-274d-4c82-8066-872b27fe6d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1cce988abe42d0a11308def29a3a67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:47:45Z,use_quota=True,user_id='cdbb601bdb8d43638e33d79778eb4210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd33c66b-1150-40c5-af1a-6131ea5b7999),volume_type_id=fd33c66b-1150-40c5-af1a-6131ea5b7999)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f510a86d-3825-4b1c-9209-4d66377840cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f510a86d-3825-4b1c-9209-4d66377840cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f8b10d-eebf-4fa1-9be5-790941ef1519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f8b10d-eebf-4fa1-9be5-790941ef1519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c352a16d-274d-4c82-8066-872b27fe6d35', 'volume_name': 'volume-c352a16d-274d-4c82-8066-872b27fe6d35', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3079c3-d8c7-4fe8-af58-8ea0b4f90df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3079c3-d8c7-4fe8-af58-8ea0b4f90df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0840dd86-04dd-47b4-9f31-9cc88ca2b47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:45 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Volume c352a16d-274d-4c82-8066-872b27fe6d35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c352a16d-274d-4c82-8066-872b27fe6d35', 'volume_size': 1}
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=656fb20d-6108-49ba-91a8-499ad0a20351,created_at=2026-06-26T03:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1870776035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=656fb20d-6108-49ba-91a8-499ad0a20351,host='devstack@QuobyteHD#QuobyteHD',id=c352a16d-274d-4c82-8066-872b27fe6d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1cce988abe42d0a11308def29a3a67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:47:45Z,use_quota=True,user_id='cdbb601bdb8d43638e33d79778eb4210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd33c66b-1150-40c5-af1a-6131ea5b7999),volume_type_id=fd33c66b-1150-40c5-af1a-6131ea5b7999)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Creating volume c352a16d-274d-4c82-8066-872b27fe6d35 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:47:45 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:47:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:45 devstack sudo[100425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35 1073741824
Jun 26 05:47:45 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:46 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8649b77b-f72f-4080-a834-e7f42833b7b6 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b05058b7-0cb7-4749-99ab-c03b08d01430" returned: 0 in 1.083s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:46 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8649b77b-f72f-4080-a834-e7f42833b7b6 tempest-VolumesGetTest-148372371 None] Lock "cinder-quobyte-b05058b7-0cb7-4749-99ab-c03b08d01430" released by "delete_volume" :: held 2.030s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:46 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-8649b77b-f72f-4080-a834-e7f42833b7b6 tempest-VolumesGetTest-148372371 None] Created reservations ['c638f831-53d3-4fff-9525-461f6d7e66c9', '8aa99240-46b4-4c03-84ac-0fa11e5af096', '20b2ce18-0c87-4ec1-a117-7e554b98869b', '0c33fd3e-cea8-4e4d-b31e-c7686cbeebfd'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:47:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8649b77b-f72f-4080-a834-e7f42833b7b6 tempest-VolumesGetTest-148372371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8649b77b-f72f-4080-a834-e7f42833b7b6 tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:46 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8649b77b-f72f-4080-a834-e7f42833b7b6 tempest-VolumesGetTest-148372371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:47:46 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8649b77b-f72f-4080-a834-e7f42833b7b6 tempest-VolumesGetTest-148372371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:47:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8649b77b-f72f-4080-a834-e7f42833b7b6 tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8649b77b-f72f-4080-a834-e7f42833b7b6 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:46 devstack sudo[100428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:47:46 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:46 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] Acquiring lock "cinder-97f6c603-0a82-47a0-b923-83960a13302d-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:47:46 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] Lock "cinder-97f6c603-0a82-47a0-b923-83960a13302d-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:47:46 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] Acquiring lock "cinder-quobyte-97f6c603-0a82-47a0-b923-83960a13302d" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:47:46 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] Lock "cinder-quobyte-97f6c603-0a82-47a0-b923-83960a13302d" acquired by "delete_volume" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:47:46 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[39506321-2aba-4111-824d-b150c03e1516]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:46 devstack sudo[100433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d
Jun 26 05:47:46 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:47 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35 1073741824" returned: 0 in 1.486s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:47 devstack sudo[100448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35
Jun 26 05:47:47 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:47 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8649b77b-f72f-4080-a834-e7f42833b7b6 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.328s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:47 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-8649b77b-f72f-4080-a834-e7f42833b7b6 tempest-VolumesGetTest-148372371 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:47:47 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-8649b77b-f72f-4080-a834-e7f42833b7b6 tempest-VolumesGetTest-148372371 None] Deleted volume successfully.
Jun 26 05:47:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8649b77b-f72f-4080-a834-e7f42833b7b6 tempest-VolumesGetTest-148372371 None] Lock "cinder-b05058b7-0cb7-4749-99ab-c03b08d01430-delete_volume" released by "delete_volume" :: held 3.707s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:47 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d" returned: 0 in 1.236s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:48 devstack sudo[100460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d
Jun 26 05:47:48 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:48 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35" returned: 0 in 0.854s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:48 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] <== create_volume: return (2434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:47:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.437s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0840dd86-04dd-47b4-9f31-9cc88ca2b47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c352a16d-274d-4c82-8066-872b27fe6d35', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87be0ad-b4f5-4b0f-a887-05bdf957a939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:48 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Volume volume-c352a16d-274d-4c82-8066-872b27fe6d35 (c352a16d-274d-4c82-8066-872b27fe6d35): created successfully
Jun 26 05:47:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87be0ad-b4f5-4b0f-a887-05bdf957a939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Flow 'volume_create_manager' (1d97181f-e47b-430a-b5bf-6f0afd0f2a4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:47:48 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-db606101-2b96-41c4-abfa-ecd6c946d7b6 tempest-GroupSnapshotsTest-1228317765 None] Created volume successfully.
Jun 26 05:47:48 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-386fa568-9808-4465-9c05-4eaf59f3c99d tempest-GroupSnapshotsTest-1228317765 None] GroupSnapshot 53026766-893e-45a8-9252-f5e4f7f7085d: creating.
Jun 26 05:47:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-386fa568-9808-4465-9c05-4eaf59f3c99d tempest-GroupSnapshotsTest-1228317765 None] Group snapshot 53026766-893e-45a8-9252-f5e4f7f7085d: creating. {{(pid=93708) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 26 05:47:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-386fa568-9808-4465-9c05-4eaf59f3c99d tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-386fa568-9808-4465-9c05-4eaf59f3c99d tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:48 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-386fa568-9808-4465-9c05-4eaf59f3c99d tempest-GroupSnapshotsTest-1228317765 None] Creating offline snapshot 16280290-c67d-4997-849a-5a6c84ca911e of volume c352a16d-274d-4c82-8066-872b27fe6d35 {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:47:48 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[3856ef28-1a23-4ae3-8a2c-23d531a645bb]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-386fa568-9808-4465-9c05-4eaf59f3c99d tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:48 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d" returned: 1 in 0.869s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 05:47:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:48 devstack sudo[100466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35
Jun 26 05:47:48 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:48 devstack sudo[100467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d
Jun 26 05:47:48 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:49 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-97f6c603-0a82-47a0-b923-83960a13302d" returned: 0 in 0.726s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] Lock "cinder-quobyte-97f6c603-0a82-47a0-b923-83960a13302d" released by "delete_volume" :: held 2.912s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:49 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-386fa568-9808-4465-9c05-4eaf59f3c99d tempest-GroupSnapshotsTest-1228317765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35" returned: 0 in 0.893s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-386fa568-9808-4465-9c05-4eaf59f3c99d tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.16280290-c67d-4997-849a-5a6c84ca911e 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:49 devstack sudo[100475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.16280290-c67d-4997-849a-5a6c84ca911e 1G
Jun 26 05:47:49 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:49 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] Created reservations ['a0a5d497-0176-4d09-adad-06925b4a2dba', '071d06ea-b838-4ba4-aa96-4ebce8e7ef51', '6d565f77-b4c7-40d6-907c-306b9f933626', '6e7f0834-4481-40b8-8480-4bfb12c97385'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:47:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:49 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:47:49 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:47:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:49 devstack sudo[100477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:47:49 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:50 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.960s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:50 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:47:50 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] Deleted volume successfully.
Jun 26 05:47:50 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-79c02cc5-e301-455d-8fb8-d059bf0f3f52 tempest-VolumesGetTest-148372371 None] Lock "cinder-97f6c603-0a82-47a0-b923-83960a13302d-delete_volume" released by "delete_volume" :: held 4.207s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:50 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-386fa568-9808-4465-9c05-4eaf59f3c99d tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.16280290-c67d-4997-849a-5a6c84ca911e 1G" returned: 0 in 1.176s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-386fa568-9808-4465-9c05-4eaf59f3c99d tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c352a16d-274d-4c82-8066-872b27fe6d35 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.16280290-c67d-4997-849a-5a6c84ca911e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:50 devstack sudo[100484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c352a16d-274d-4c82-8066-872b27fe6d35 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.16280290-c67d-4997-849a-5a6c84ca911e
Jun 26 05:47:50 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:51 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-386fa568-9808-4465-9c05-4eaf59f3c99d tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c352a16d-274d-4c82-8066-872b27fe6d35 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.16280290-c67d-4997-849a-5a6c84ca911e" returned: 0 in 0.902s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:51 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-386fa568-9808-4465-9c05-4eaf59f3c99d tempest-GroupSnapshotsTest-1228317765 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.16280290-c67d-4997-849a-5a6c84ca911e is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 05:47:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-386fa568-9808-4465-9c05-4eaf59f3c99d tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.16280290-c67d-4997-849a-5a6c84ca911e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:51 devstack sudo[100492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.16280290-c67d-4997-849a-5a6c84ca911e
Jun 26 05:47:51 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:52 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-386fa568-9808-4465-9c05-4eaf59f3c99d tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.16280290-c67d-4997-849a-5a6c84ca911e" returned: 0 in 0.743s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-386fa568-9808-4465-9c05-4eaf59f3c99d tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:52 devstack sudo[100495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.info
Jun 26 05:47:52 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:53 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-386fa568-9808-4465-9c05-4eaf59f3c99d tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.info" returned: 0 in 0.761s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:53 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-386fa568-9808-4465-9c05-4eaf59f3c99d tempest-GroupSnapshotsTest-1228317765 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 05:47:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-386fa568-9808-4465-9c05-4eaf59f3c99d tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:53 devstack sudo[100499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.info
Jun 26 05:47:53 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:53 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:47:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Flow 'volume_create_manager' (b736a2ca-e940-4393-8e72-c85c30bafbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:47:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5069464b-b4d7-450b-8afd-47ea49db73dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5069464b-b4d7-450b-8afd-47ea49db73dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-227676159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f58cfdc-9a80-4958-bdd3-d9eb1c522116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='855624b047174999aa0ec63b23eb94f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:47:54Z,use_quota=True,user_id='6167b704682b4a1bb888bca1f3599d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bddbe07-dfc0-48b5-bbdc-2e6d9011058a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bddbe07-dfc0-48b5-bbdc-2e6d9011058a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70efaa0a-691b-4bf6-bdc3-077437284cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70efaa0a-691b-4bf6-bdc3-077437284cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f58cfdc-9a80-4958-bdd3-d9eb1c522116', 'volume_name': 'volume-3f58cfdc-9a80-4958-bdd3-d9eb1c522116', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3baf8ad7-8ded-4d22-8beb-2cdeef536ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3baf8ad7-8ded-4d22-8beb-2cdeef536ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e970b2b-54df-4b88-bcf6-f3613c07168c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:53 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Volume 3f58cfdc-9a80-4958-bdd3-d9eb1c522116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f58cfdc-9a80-4958-bdd3-d9eb1c522116', 'volume_size': 1}
Jun 26 05:47:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:53 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-386fa568-9808-4465-9c05-4eaf59f3c99d tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.info" returned: 0 in 0.849s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-386fa568-9808-4465-9c05-4eaf59f3c99d tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.429s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.062s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-227676159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f58cfdc-9a80-4958-bdd3-d9eb1c522116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='855624b047174999aa0ec63b23eb94f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:47:54Z,use_quota=True,user_id='6167b704682b4a1bb888bca1f3599d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:47:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Creating volume 3f58cfdc-9a80-4958-bdd3-d9eb1c522116 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:47:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:47:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:47:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:47:54 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:47:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f58cfdc-9a80-4958-bdd3-d9eb1c522116 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:54 devstack sudo[100509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f58cfdc-9a80-4958-bdd3-d9eb1c522116 1073741824
Jun 26 05:47:54 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:54 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-386fa568-9808-4465-9c05-4eaf59f3c99d tempest-GroupSnapshotsTest-1228317765 None] group_snapshot 53026766-893e-45a8-9252-f5e4f7f7085d: created successfully
Jun 26 05:47:55 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f58cfdc-9a80-4958-bdd3-d9eb1c522116 1073741824" returned: 0 in 1.005s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f58cfdc-9a80-4958-bdd3-d9eb1c522116 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:55 devstack sudo[100515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f58cfdc-9a80-4958-bdd3-d9eb1c522116
Jun 26 05:47:55 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:55 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] group_snapshot 53026766-893e-45a8-9252-f5e4f7f7085d: deleting
Jun 26 05:47:55 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] group_snapshot 53026766-893e-45a8-9252-f5e4f7f7085d: deleting {{(pid=93708) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 26 05:47:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "cinder-quobyte-c352a16d-274d-4c82-8066-872b27fe6d35" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:47:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-c352a16d-274d-4c82-8066-872b27fe6d35" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:47:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "cinder-quobyte-16280290-c67d-4997-849a-5a6c84ca911e" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:47:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-16280290-c67d-4997-849a-5a6c84ca911e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:47:55 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] Deleting offline snapshot 16280290-c67d-4997-849a-5a6c84ca911e of volume c352a16d-274d-4c82-8066-872b27fe6d35 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:47:55 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] snapshot_file for this snap is: volume-c352a16d-274d-4c82-8066-872b27fe6d35.16280290-c67d-4997-849a-5a6c84ca911e {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:47:55 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c8160c-5d23-4ab9-afcc-4494d0d7afc4]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.16280290-c67d-4997-849a-5a6c84ca911e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:55 devstack sudo[100517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.16280290-c67d-4997-849a-5a6c84ca911e
Jun 26 05:47:55 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:55 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f58cfdc-9a80-4958-bdd3-d9eb1c522116" returned: 0 in 0.881s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:55 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:47:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:55 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e970b2b-54df-4b88-bcf6-f3613c07168c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f58cfdc-9a80-4958-bdd3-d9eb1c522116', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:55 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f3dba1-5bfc-44b1-9ae3-996323aca104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:56 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Volume volume-3f58cfdc-9a80-4958-bdd3-d9eb1c522116 (3f58cfdc-9a80-4958-bdd3-d9eb1c522116): created successfully
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f3dba1-5bfc-44b1-9ae3-996323aca104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Flow 'volume_create_manager' (b736a2ca-e940-4393-8e72-c85c30bafbae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:47:56 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-d9d962c0-b335-4838-99d2-a7af8321eaea tempest-VolumesNegativeTest-959564117 None] Created volume successfully.
Jun 26 05:47:56 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.16280290-c67d-4997-849a-5a6c84ca911e" returned: 0 in 1.027s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c352a16d-274d-4c82-8066-872b27fe6d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[395354ae-1a36-47a8-bc4b-68d7ebb3feb4]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Flow 'volume_create_manager' (feb93d49-427f-4ceb-8ed3-18d98d114258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d4e96cb-08d2-4c6e-8789-025c78343902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:56 devstack sudo[100523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35
Jun 26 05:47:56 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d4e96cb-08d2-4c6e-8789-025c78343902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1047168133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb914fb-be10-483d-ab3b-669762e618db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ec9682d5f646a98736f6c5aafc8637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:47:56Z,use_quota=True,user_id='b90e7484a17a40bab387a160b0c60f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6898b396-2c0e-41e3-9673-1f6cdd1b15aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6898b396-2c0e-41e3-9673-1f6cdd1b15aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a86cc1-eec5-4d57-ba16-6a1118003e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a86cc1-eec5-4d57-ba16-6a1118003e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeb914fb-be10-483d-ab3b-669762e618db', 'volume_name': 'volume-aeb914fb-be10-483d-ab3b-669762e618db', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb4cfb0-5ec3-4499-ac0b-8f76a2f3290e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb4cfb0-5ec3-4499-ac0b-8f76a2f3290e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c69585c5-f419-4892-8ff3-a4ba12787c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:56 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Volume aeb914fb-be10-483d-ab3b-669762e618db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeb914fb-be10-483d-ab3b-669762e618db', 'volume_size': 1}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1047168133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb914fb-be10-483d-ab3b-669762e618db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ec9682d5f646a98736f6c5aafc8637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:47:56Z,use_quota=True,user_id='b90e7484a17a40bab387a160b0c60f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Creating volume aeb914fb-be10-483d-ab3b-669762e618db {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:47:56 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:47:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:56 devstack sudo[100525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db 1073741824
Jun 26 05:47:56 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:57 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35" returned: 0 in 0.808s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.16280290-c67d-4997-849a-5a6c84ca911e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:57 devstack sudo[100534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.16280290-c67d-4997-849a-5a6c84ca911e
Jun 26 05:47:57 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:57 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db 1073741824" returned: 0 in 0.897s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:57 devstack sudo[100537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db
Jun 26 05:47:57 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:58 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.16280290-c67d-4997-849a-5a6c84ca911e" returned: 0 in 0.791s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.16280290-c67d-4997-849a-5a6c84ca911e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:58 devstack sudo[100546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.16280290-c67d-4997-849a-5a6c84ca911e
Jun 26 05:47:58 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:58 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db" returned: 0 in 0.704s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:47:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:47:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c69585c5-f419-4892-8ff3-a4ba12787c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb914fb-be10-483d-ab3b-669762e618db', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080bf907-5670-49aa-982f-9290298887cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:47:58 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Volume volume-aeb914fb-be10-483d-ab3b-669762e618db (aeb914fb-be10-483d-ab3b-669762e618db): created successfully
Jun 26 05:47:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080bf907-5670-49aa-982f-9290298887cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:47:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Flow 'volume_create_manager' (feb93d49-427f-4ceb-8ed3-18d98d114258) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:47:58 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-f26d8d81-e1ed-4308-800c-517d2645a958 req-6d8512d1-8903-4ce1-aa9e-8f9d395259ae tempest-VolumesSnapshotsTestJSON-420832964 None] Created volume successfully.
Jun 26 05:47:58 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35.16280290-c67d-4997-849a-5a6c84ca911e" returned: 0 in 0.687s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:58 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-16280290-c67d-4997-849a-5a6c84ca911e" released by "_delete_snapshot" :: held 3.449s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:58 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-c352a16d-274d-4c82-8066-872b27fe6d35" released by "delete_snapshot" :: held 3.494s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:47:58 devstack cinder-volume[93708]: WARNING cinder.quota [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-592200867 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-592200867, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:47:58 devstack cinder-volume[93708]: WARNING cinder.quota [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-592200867 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-592200867, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:47:58 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] Created reservations ['69840ba7-49fc-44b1-803d-b63c4b5a95ec', 'dd8cfe02-8794-4bf6-9691-5e1cd11ebc42', 'dce5128a-4136-4a2d-a228-1256877ff6e2', '863561c5-4f8d-45ba-a8dc-f54f4e2732c3'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:47:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-40525b45-66ca-498c-bd81-a342e06be07f req-11c72c14-9034-47f7-b235-93111f85f8b0 tempest-VolumesSnapshotsTestJSON-420832964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:47:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-40525b45-66ca-498c-bd81-a342e06be07f req-11c72c14-9034-47f7-b235-93111f85f8b0 tempest-VolumesSnapshotsTestJSON-420832964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:47:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [req-40525b45-66ca-498c-bd81-a342e06be07f req-11c72c14-9034-47f7-b235-93111f85f8b0 tempest-VolumesSnapshotsTestJSON-420832964 None] Creating offline snapshot ce4af92f-6c49-4837-bd61-0ef48193a58e of volume aeb914fb-be10-483d-ab3b-669762e618db {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:47:59 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d823b56-5c53-4cd0-921a-8d83eeb21d89]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:47:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-40525b45-66ca-498c-bd81-a342e06be07f req-11c72c14-9034-47f7-b235-93111f85f8b0 tempest-VolumesSnapshotsTestJSON-420832964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:59 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-65c30bd4-be51-4308-8052-0e9c82bae9fe tempest-GroupSnapshotsTest-1228317765 None] group_snapshot 53026766-893e-45a8-9252-f5e4f7f7085d: deleted successfully
Jun 26 05:47:59 devstack sudo[100551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db
Jun 26 05:47:59 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:47:59 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root
Jun 26 05:47:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-40525b45-66ca-498c-bd81-a342e06be07f req-11c72c14-9034-47f7-b235-93111f85f8b0 tempest-VolumesSnapshotsTestJSON-420832964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db" returned: 0 in 0.810s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:47:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-40525b45-66ca-498c-bd81-a342e06be07f req-11c72c14-9034-47f7-b235-93111f85f8b0 tempest-VolumesSnapshotsTestJSON-420832964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.ce4af92f-6c49-4837-bd61-0ef48193a58e 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:47:59 devstack sudo[100568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.ce4af92f-6c49-4837-bd61-0ef48193a58e 1G
Jun 26 05:47:59 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:00 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7962a87d-2cc4-4ea6-88dc-223351b2a6fc tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "cinder-quobyte-c352a16d-274d-4c82-8066-872b27fe6d35" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:48:00 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7962a87d-2cc4-4ea6-88dc-223351b2a6fc tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-c352a16d-274d-4c82-8066-872b27fe6d35" acquired by "delete_volume" :: waited 0.029s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:48:00 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fbb9ff-f9a7-4bbd-97fc-565cc7a519fd]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:48:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7962a87d-2cc4-4ea6-88dc-223351b2a6fc tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:00 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:48:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Flow 'volume_create_manager' (07045046-d139-42fc-8626-64451d757cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:48:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878efa47-984f-498a-9e02-faf9cb459360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878efa47-984f-498a-9e02-faf9cb459360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-196820256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad43f02466524bf1a0cbd95bc7de35b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:48:00Z,use_quota=True,user_id='8e5cac8a1d734889b9ba485b7d88a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3dbe3d3-687c-456b-bb09-c3bbe020cb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3dbe3d3-687c-456b-bb09-c3bbe020cb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5501f46-2fbb-43ce-b6f4-97f832dca077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:00 devstack sudo[100570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35
Jun 26 05:48:00 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5501f46-2fbb-43ce-b6f4-97f832dca077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe', 'volume_name': 'volume-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365eee30-4ece-42de-a987-18feb4126de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365eee30-4ece-42de-a987-18feb4126de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dab22a9-06f6-4a8a-9b17-d0e76fbb5acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:00 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Volume c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe', 'volume_size': 1}
Jun 26 05:48:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:00 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-40525b45-66ca-498c-bd81-a342e06be07f req-11c72c14-9034-47f7-b235-93111f85f8b0 tempest-VolumesSnapshotsTestJSON-420832964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.ce4af92f-6c49-4837-bd61-0ef48193a58e 1G" returned: 0 in 0.964s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-40525b45-66ca-498c-bd81-a342e06be07f req-11c72c14-9034-47f7-b235-93111f85f8b0 tempest-VolumesSnapshotsTestJSON-420832964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeb914fb-be10-483d-ab3b-669762e618db -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.ce4af92f-6c49-4837-bd61-0ef48193a58e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:00 devstack sudo[100575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeb914fb-be10-483d-ab3b-669762e618db -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.ce4af92f-6c49-4837-bd61-0ef48193a58e
Jun 26 05:48:00 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:01 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7962a87d-2cc4-4ea6-88dc-223351b2a6fc tempest-GroupSnapshotsTest-1228317765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35" returned: 0 in 0.822s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7962a87d-2cc4-4ea6-88dc-223351b2a6fc tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:01 devstack sudo[100580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35
Jun 26 05:48:01 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:01 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-40525b45-66ca-498c-bd81-a342e06be07f req-11c72c14-9034-47f7-b235-93111f85f8b0 tempest-VolumesSnapshotsTestJSON-420832964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeb914fb-be10-483d-ab3b-669762e618db -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.ce4af92f-6c49-4837-bd61-0ef48193a58e" returned: 0 in 0.780s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:01 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [req-40525b45-66ca-498c-bd81-a342e06be07f req-11c72c14-9034-47f7-b235-93111f85f8b0 tempest-VolumesSnapshotsTestJSON-420832964 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.ce4af92f-6c49-4837-bd61-0ef48193a58e is being set with open permissions: ugo+rw
Jun 26 05:48:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-40525b45-66ca-498c-bd81-a342e06be07f req-11c72c14-9034-47f7-b235-93111f85f8b0 tempest-VolumesSnapshotsTestJSON-420832964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.ce4af92f-6c49-4837-bd61-0ef48193a58e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:01 devstack sudo[100590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.ce4af92f-6c49-4837-bd61-0ef48193a58e
Jun 26 05:48:01 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:01 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7962a87d-2cc4-4ea6-88dc-223351b2a6fc tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c352a16d-274d-4c82-8066-872b27fe6d35" returned: 0 in 0.727s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:01 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7962a87d-2cc4-4ea6-88dc-223351b2a6fc tempest-GroupSnapshotsTest-1228317765 None] Lock "cinder-quobyte-c352a16d-274d-4c82-8066-872b27fe6d35" released by "delete_volume" :: held 1.653s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:48:01 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-7962a87d-2cc4-4ea6-88dc-223351b2a6fc tempest-GroupSnapshotsTest-1228317765 None] Created reservations ['7db1335c-3c2a-49b6-88f7-258f163f43b3'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:48:01 devstack cinder-volume[93708]: WARNING cinder.quota [None req-7962a87d-2cc4-4ea6-88dc-223351b2a6fc tempest-GroupSnapshotsTest-1228317765 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-592200867 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-592200867, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:48:01 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-7962a87d-2cc4-4ea6-88dc-223351b2a6fc tempest-GroupSnapshotsTest-1228317765 None] Created reservations ['67a6306a-68b7-43dc-ad60-011b408a65ce', '8c225ace-6d51-4811-ac2b-fdcfaf47e845', '5af50b44-5819-4170-8da2-7125fab31c78', 'a060d750-32f2-4988-bca5-9dbb2f6acf43'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:48:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7962a87d-2cc4-4ea6-88dc-223351b2a6fc tempest-GroupSnapshotsTest-1228317765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7962a87d-2cc4-4ea6-88dc-223351b2a6fc tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7962a87d-2cc4-4ea6-88dc-223351b2a6fc tempest-GroupSnapshotsTest-1228317765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:48:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7962a87d-2cc4-4ea6-88dc-223351b2a6fc tempest-GroupSnapshotsTest-1228317765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:48:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7962a87d-2cc4-4ea6-88dc-223351b2a6fc tempest-GroupSnapshotsTest-1228317765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7962a87d-2cc4-4ea6-88dc-223351b2a6fc tempest-GroupSnapshotsTest-1228317765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:02 devstack sudo[100593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:48:02 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:02 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-40525b45-66ca-498c-bd81-a342e06be07f req-11c72c14-9034-47f7-b235-93111f85f8b0 tempest-VolumesSnapshotsTestJSON-420832964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.ce4af92f-6c49-4837-bd61-0ef48193a58e" returned: 0 in 0.712s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-40525b45-66ca-498c-bd81-a342e06be07f req-11c72c14-9034-47f7-b235-93111f85f8b0 tempest-VolumesSnapshotsTestJSON-420832964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:02 devstack sudo[100596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.info
Jun 26 05:48:02 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:02 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7962a87d-2cc4-4ea6-88dc-223351b2a6fc tempest-GroupSnapshotsTest-1228317765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.727s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:02 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-7962a87d-2cc4-4ea6-88dc-223351b2a6fc tempest-GroupSnapshotsTest-1228317765 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:48:02 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-7962a87d-2cc4-4ea6-88dc-223351b2a6fc tempest-GroupSnapshotsTest-1228317765 None] Delete group completed successfully.
Jun 26 05:48:03 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-40525b45-66ca-498c-bd81-a342e06be07f req-11c72c14-9034-47f7-b235-93111f85f8b0 tempest-VolumesSnapshotsTestJSON-420832964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.info" returned: 0 in 0.847s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:03 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [req-40525b45-66ca-498c-bd81-a342e06be07f req-11c72c14-9034-47f7-b235-93111f85f8b0 tempest-VolumesSnapshotsTestJSON-420832964 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.info is being set with open permissions: ugo+rw
Jun 26 05:48:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-40525b45-66ca-498c-bd81-a342e06be07f req-11c72c14-9034-47f7-b235-93111f85f8b0 tempest-VolumesSnapshotsTestJSON-420832964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:03 devstack sudo[100600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.info
Jun 26 05:48:03 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:03 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-40525b45-66ca-498c-bd81-a342e06be07f req-11c72c14-9034-47f7-b235-93111f85f8b0 tempest-VolumesSnapshotsTestJSON-420832964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.info" returned: 0 in 0.825s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-40525b45-66ca-498c-bd81-a342e06be07f req-11c72c14-9034-47f7-b235-93111f85f8b0 tempest-VolumesSnapshotsTestJSON-420832964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.073s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.643s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-196820256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad43f02466524bf1a0cbd95bc7de35b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:48:00Z,use_quota=True,user_id='8e5cac8a1d734889b9ba485b7d88a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Creating volume c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:48:04 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:04 devstack sudo[100603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe 1073741824
Jun 26 05:48:04 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:04 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-40525b45-66ca-498c-bd81-a342e06be07f req-11c72c14-9034-47f7-b235-93111f85f8b0 tempest-VolumesSnapshotsTestJSON-420832964 None] Create snapshot completed successfully
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] Acquiring lock "cinder-ce4af92f-6c49-4837-bd61-0ef48193a58e-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] Lock "cinder-ce4af92f-6c49-4837-bd61-0ef48193a58e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] Acquiring lock "cinder-quobyte-aeb914fb-be10-483d-ab3b-669762e618db" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] Lock "cinder-quobyte-aeb914fb-be10-483d-ab3b-669762e618db" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] Acquiring lock "cinder-quobyte-ce4af92f-6c49-4837-bd61-0ef48193a58e" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] Lock "cinder-quobyte-ce4af92f-6c49-4837-bd61-0ef48193a58e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] Deleting offline snapshot ce4af92f-6c49-4837-bd61-0ef48193a58e of volume aeb914fb-be10-483d-ab3b-669762e618db {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] snapshot_file for this snap is: volume-aeb914fb-be10-483d-ab3b-669762e618db.ce4af92f-6c49-4837-bd61-0ef48193a58e {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daff2a3-946f-4e59-8778-cbf16a18c451]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:48:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.ce4af92f-6c49-4837-bd61-0ef48193a58e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:05 devstack sudo[100614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.ce4af92f-6c49-4837-bd61-0ef48193a58e
Jun 26 05:48:05 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:05 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe 1073741824" returned: 0 in 1.268s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:05 devstack sudo[100627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe
Jun 26 05:48:05 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:06 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.ce4af92f-6c49-4837-bd61-0ef48193a58e" returned: 0 in 1.203s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeb914fb-be10-483d-ab3b-669762e618db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:48:06 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf6049f-bad1-4d4b-a8ab-b6ea2f81dcd1]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:48:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:06 devstack sudo[100633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db
Jun 26 05:48:06 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:06 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe" returned: 0 in 0.894s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] <== create_volume: return (2225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:48:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.230s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:06 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dab22a9-06f6-4a8a-9b17-d0e76fbb5acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:06 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da3bc72-f699-48d8-a12b-cc7925b80ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:06 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Volume volume-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe (c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe): created successfully
Jun 26 05:48:06 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da3bc72-f699-48d8-a12b-cc7925b80ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:06 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Flow 'volume_create_manager' (07045046-d139-42fc-8626-64451d757cf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:48:06 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-cce80c7c-1eed-4c02-8fdd-eadd1effc44b tempest-AttachVolumeTestJSON-1893104206 None] Created volume successfully.
Jun 26 05:48:06 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db" returned: 0 in 0.936s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.ce4af92f-6c49-4837-bd61-0ef48193a58e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:07 devstack sudo[100644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.ce4af92f-6c49-4837-bd61-0ef48193a58e
Jun 26 05:48:07 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:07 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.ce4af92f-6c49-4837-bd61-0ef48193a58e" returned: 0 in 0.799s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.ce4af92f-6c49-4837-bd61-0ef48193a58e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:07 devstack sudo[100650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.ce4af92f-6c49-4837-bd61-0ef48193a58e
Jun 26 05:48:07 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:08 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db.ce4af92f-6c49-4837-bd61-0ef48193a58e" returned: 0 in 0.699s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:08 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] Lock "cinder-quobyte-ce4af92f-6c49-4837-bd61-0ef48193a58e" released by "_delete_snapshot" :: held 3.793s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:48:08 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] Lock "cinder-quobyte-aeb914fb-be10-483d-ab3b-669762e618db" released by "delete_snapshot" :: held 3.830s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:48:08 devstack cinder-volume[93708]: WARNING cinder.quota [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:48:08 devstack cinder-volume[93708]: DEBUG cinder.quota [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] Created reservations ['7a92a306-3d94-4257-a0aa-0231ebcde7c1', '37795346-b90d-496f-a4b0-2cea97bc2315', 'f276cbf4-d1fd-4255-875b-7b57ffccbe78', 'b6e91c4a-77af-417b-80cb-cadbc79bc917'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:48:08 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] Delete snapshot completed successfully.
Jun 26 05:48:08 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-ae0f41c1-737f-4158-8d3d-0c68829a6690 req-77d1da0c-2131-4662-8879-eb85274777b6 tempest-VolumesSnapshotsTestJSON-420832964 None] Lock "cinder-ce4af92f-6c49-4837-bd61-0ef48193a58e-delete_snapshot" released by "delete_snapshot" :: held 3.979s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:48:08 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-fbe3682f-de37-408c-8cf5-1d1559f77c33 tempest-GroupsV314Test-1450158271 None] Group tempest-GroupsV314Test-Group-1356632029: creating
Jun 26 05:48:08 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-fbe3682f-de37-408c-8cf5-1d1559f77c33 tempest-GroupsV314Test-1450158271 None] Group tempest-GroupsV314Test-Group-1356632029: created successfully
Jun 26 05:48:09 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-fbe3682f-de37-408c-8cf5-1d1559f77c33 tempest-GroupsV314Test-1450158271 None] Create group completed successfully.
Jun 26 05:48:09 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-bcf44170-958b-4cad-a2a6-67c9c55c5145 req-ddef8b12-5b94-4481-a5e1-f3614f0329d4 tempest-VolumesSnapshotsTestJSON-420832964 None] Acquiring lock "cinder-aeb914fb-be10-483d-ab3b-669762e618db-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:48:09 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-bcf44170-958b-4cad-a2a6-67c9c55c5145 req-ddef8b12-5b94-4481-a5e1-f3614f0329d4 tempest-VolumesSnapshotsTestJSON-420832964 None] Lock "cinder-aeb914fb-be10-483d-ab3b-669762e618db-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:48:09 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-bcf44170-958b-4cad-a2a6-67c9c55c5145 req-ddef8b12-5b94-4481-a5e1-f3614f0329d4 tempest-VolumesSnapshotsTestJSON-420832964 None] Acquiring lock "cinder-quobyte-aeb914fb-be10-483d-ab3b-669762e618db" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:48:09 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-bcf44170-958b-4cad-a2a6-67c9c55c5145 req-ddef8b12-5b94-4481-a5e1-f3614f0329d4 tempest-VolumesSnapshotsTestJSON-420832964 None] Lock "cinder-quobyte-aeb914fb-be10-483d-ab3b-669762e618db" acquired by "delete_volume" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:48:09 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4c5d26-f9c0-415f-91d4-ae40b3053bd1]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:48:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-bcf44170-958b-4cad-a2a6-67c9c55c5145 req-ddef8b12-5b94-4481-a5e1-f3614f0329d4 tempest-VolumesSnapshotsTestJSON-420832964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:09 devstack sudo[100657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db
Jun 26 05:48:09 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-da1936fd-9625-474d-be95-3718c62850c8 req-40616e53-d58c-4b1f-a72e-15c3d4590d56 tempest-AttachVolumeTestJSON-1893104206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-da1936fd-9625-474d-be95-3718c62850c8 req-40616e53-d58c-4b1f-a72e-15c3d4590d56 tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:09 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f72c9b2-be01-4a34-8e53-b0bd589dee15]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:48:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-da1936fd-9625-474d-be95-3718c62850c8 req-40616e53-d58c-4b1f-a72e-15c3d4590d56 tempest-AttachVolumeTestJSON-1893104206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:09 devstack sudo[100667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe
Jun 26 05:48:09 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:10 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-bcf44170-958b-4cad-a2a6-67c9c55c5145 req-ddef8b12-5b94-4481-a5e1-f3614f0329d4 tempest-VolumesSnapshotsTestJSON-420832964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db" returned: 0 in 0.816s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-bcf44170-958b-4cad-a2a6-67c9c55c5145 req-ddef8b12-5b94-4481-a5e1-f3614f0329d4 tempest-VolumesSnapshotsTestJSON-420832964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:10 devstack sudo[100672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db
Jun 26 05:48:10 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:48:10 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Flow 'volume_create_manager' (b603792f-1f84-4f5d-8958-8f8e5eb811da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ceb740-c44e-4784-9697-2592c70e4aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-da1936fd-9625-474d-be95-3718c62850c8 req-40616e53-d58c-4b1f-a72e-15c3d4590d56 tempest-AttachVolumeTestJSON-1893104206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe" returned: 0 in 0.945s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-da1936fd-9625-474d-be95-3718c62850c8 req-40616e53-d58c-4b1f-a72e-15c3d4590d56 tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.970s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ceb740-c44e-4784-9697-2592c70e4aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1835566039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8cb498ad-6bf3-4faa-a9f7-25d9547d4dba,host='devstack@QuobyteHD#QuobyteHD',id=65c43a65-ebc1-4851-8d3b-dda9815d2c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f7e73a14768444e984e2b1d8f7edd9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:48:11Z,use_quota=True,user_id='9c4da36a2fda43579f2aab1e21b3c168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3ce2856-f748-473a-99b7-320f6b7b6e13),volume_type_id=f3ce2856-f748-473a-99b7-320f6b7b6e13)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:10 devstack sudo[100681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:48:10 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c74233-c2d5-4d0e-9e63-05bbef70dae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c74233-c2d5-4d0e-9e63-05bbef70dae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bce099-e42f-4fdc-972c-ab0ce0152fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bce099-e42f-4fdc-972c-ab0ce0152fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65c43a65-ebc1-4851-8d3b-dda9815d2c3a', 'volume_name': 'volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38b31c4-3909-40b1-96f7-dcbc2c18235c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38b31c4-3909-40b1-96f7-dcbc2c18235c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de981cd-615e-4877-9479-bc35176db083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:10 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Volume 65c43a65-ebc1-4851-8d3b-dda9815d2c3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a', 'volume_size': 1}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8cb498ad-6bf3-4faa-a9f7-25d9547d4dba,created_at=2026-06-26T03:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1835566039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8cb498ad-6bf3-4faa-a9f7-25d9547d4dba,host='devstack@QuobyteHD#QuobyteHD',id=65c43a65-ebc1-4851-8d3b-dda9815d2c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f7e73a14768444e984e2b1d8f7edd9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:48:11Z,use_quota=True,user_id='9c4da36a2fda43579f2aab1e21b3c168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3ce2856-f748-473a-99b7-320f6b7b6e13),volume_type_id=f3ce2856-f748-473a-99b7-320f6b7b6e13)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Creating volume 65c43a65-ebc1-4851-8d3b-dda9815d2c3a {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:48:10 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:10 devstack sudo[100685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a 1073741824
Jun 26 05:48:10 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-da1936fd-9625-474d-be95-3718c62850c8 req-40616e53-d58c-4b1f-a72e-15c3d4590d56 tempest-AttachVolumeTestJSON-1893104206 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85', 'name': 'volume-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d71c63f-85fd-46d6-9699-69394b3a17cf', 'enforce_multipath': True} {{(pid=93708) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 05:48:10 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-bcf44170-958b-4cad-a2a6-67c9c55c5145 req-ddef8b12-5b94-4481-a5e1-f3614f0329d4 tempest-VolumesSnapshotsTestJSON-420832964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aeb914fb-be10-483d-ab3b-669762e618db" returned: 0 in 0.829s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:10 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-bcf44170-958b-4cad-a2a6-67c9c55c5145 req-ddef8b12-5b94-4481-a5e1-f3614f0329d4 tempest-VolumesSnapshotsTestJSON-420832964 None] Lock "cinder-quobyte-aeb914fb-be10-483d-ab3b-669762e618db" released by "delete_volume" :: held 1.721s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:48:11 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-da1936fd-9625-474d-be95-3718c62850c8 req-40616e53-d58c-4b1f-a72e-15c3d4590d56 tempest-AttachVolumeTestJSON-1893104206 None] attachment_update completed successfully.
Jun 26 05:48:11 devstack cinder-volume[93708]: DEBUG cinder.quota [req-bcf44170-958b-4cad-a2a6-67c9c55c5145 req-ddef8b12-5b94-4481-a5e1-f3614f0329d4 tempest-VolumesSnapshotsTestJSON-420832964 None] Created reservations ['89fec60a-7834-4dcd-b51f-b6245bf27d27', '4abaef5b-5634-4eeb-93a7-7510078121f1', '3ee9dc8a-5cdd-4559-ae22-5ba974366643', '1ec717a3-7997-47de-bede-f0bc581dca62'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:48:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-bcf44170-958b-4cad-a2a6-67c9c55c5145 req-ddef8b12-5b94-4481-a5e1-f3614f0329d4 tempest-VolumesSnapshotsTestJSON-420832964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-bcf44170-958b-4cad-a2a6-67c9c55c5145 req-ddef8b12-5b94-4481-a5e1-f3614f0329d4 tempest-VolumesSnapshotsTestJSON-420832964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [req-bcf44170-958b-4cad-a2a6-67c9c55c5145 req-ddef8b12-5b94-4481-a5e1-f3614f0329d4 tempest-VolumesSnapshotsTestJSON-420832964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:48:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [req-bcf44170-958b-4cad-a2a6-67c9c55c5145 req-ddef8b12-5b94-4481-a5e1-f3614f0329d4 tempest-VolumesSnapshotsTestJSON-420832964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:48:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-bcf44170-958b-4cad-a2a6-67c9c55c5145 req-ddef8b12-5b94-4481-a5e1-f3614f0329d4 tempest-VolumesSnapshotsTestJSON-420832964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-bcf44170-958b-4cad-a2a6-67c9c55c5145 req-ddef8b12-5b94-4481-a5e1-f3614f0329d4 tempest-VolumesSnapshotsTestJSON-420832964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:11 devstack sudo[100692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:48:11 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:11 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.153s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:11 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:48:11 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:48:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 28 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:48:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>, <Thread(tpool_thread_0, started daemon 124035494721216)>, <Thread(tpool_thread_1, started daemon 124035486328512)>, <Thread(tpool_thread_2, started daemon 124035477919424)>, <Thread(tpool_thread_3, started daemon 124035469510336)>, <Thread(tpool_thread_4, started daemon 124035461101248)>, <Thread(tpool_thread_5, started daemon 124035452692160)>, <Thread(tpool_thread_6, started daemon 124035444283072)>, <Thread(tpool_thread_7, started daemon 124035435873984)>, <Thread(tpool_thread_8, started daemon 124035427464896)>, <Thread(tpool_thread_9, started daemon 124035419055808)>, <Thread(tpool_thread_10, started daemon 124035410646720)>, <Thread(tpool_thread_11, started daemon 124035402237632)>, <Thread(tpool_thread_12, started daemon 124035393828544)>, <Thread(tpool_thread_13, started daemon 124035385419456)>, <Thread(tpool_thread_14, started daemon 124035377010368)>, <Thread(tpool_thread_15, started daemon 124035368601280)>, <Thread(tpool_thread_16, started daemon 124035360192192)>, <Thread(tpool_thread_17, started daemon 124035351783104)>, <Thread(tpool_thread_18, started daemon 124035343374016)>, <Thread(tpool_thread_19, started daemon 124035334964928)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:48:12 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a 1073741824" returned: 0 in 1.598s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:12 devstack sudo[101145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a
Jun 26 05:48:12 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:12 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-bcf44170-958b-4cad-a2a6-67c9c55c5145 req-ddef8b12-5b94-4481-a5e1-f3614f0329d4 tempest-VolumesSnapshotsTestJSON-420832964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.454s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:12 devstack cinder-volume[93708]: DEBUG cinder.manager [req-bcf44170-958b-4cad-a2a6-67c9c55c5145 req-ddef8b12-5b94-4481-a5e1-f3614f0329d4 tempest-VolumesSnapshotsTestJSON-420832964 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:48:12 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-bcf44170-958b-4cad-a2a6-67c9c55c5145 req-ddef8b12-5b94-4481-a5e1-f3614f0329d4 tempest-VolumesSnapshotsTestJSON-420832964 None] Deleted volume successfully.
Jun 26 05:48:12 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-bcf44170-958b-4cad-a2a6-67c9c55c5145 req-ddef8b12-5b94-4481-a5e1-f3614f0329d4 tempest-VolumesSnapshotsTestJSON-420832964 None] Lock "cinder-aeb914fb-be10-483d-ab3b-669762e618db-delete_volume" released by "delete_volume" :: held 3.593s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:48:13 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a" returned: 0 in 1.214s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:13 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] <== create_volume: return (2907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:48:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.909s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:13 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de981cd-615e-4877-9479-bc35176db083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:13 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07cec609-8cec-4108-aa50-5eb0fc5afa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:13 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Volume volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a (65c43a65-ebc1-4851-8d3b-dda9815d2c3a): created successfully
Jun 26 05:48:13 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07cec609-8cec-4108-aa50-5eb0fc5afa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:13 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Flow 'volume_create_manager' (b603792f-1f84-4f5d-8958-8f8e5eb811da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:48:13 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-2f480f45-c05d-426e-b707-1828ef3c41b5 tempest-GroupsV314Test-1450158271 None] Created volume successfully.
Jun 26 05:48:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:15 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Cloning volume 65c43a65-ebc1-4851-8d3b-dda9815d2c3a to volume 8d09d7fd-6abe-4032-a1f8-0c3899058f98
Jun 26 05:48:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Creating offline snapshot 05e171a0-bac7-4528-8039-b83e213dc6e3 of volume 65c43a65-ebc1-4851-8d3b-dda9815d2c3a {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:48:15 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[2905aed1-6114-4e69-98cd-615c04ce7a8f]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:48:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:16 devstack sudo[101163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a
Jun 26 05:48:16 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:17 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a" returned: 0 in 1.534s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:17 devstack sudo[101196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3 1G
Jun 26 05:48:17 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:18 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:48:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Flow 'volume_create_manager' (6e42ac5a-a6fd-4252-ba35-a444e59108ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:48:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1770dcd8-4276-46db-ac12-76c61a6ac738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1770dcd8-4276-46db-ac12-76c61a6ac738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1698326078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7104df-3cfa-4fc2-94cb-ea318564cf66,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1f3f020714a47cba8d442ec7a1b29ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:48:18Z,use_quota=True,user_id='d7371b308d39486286f044ea06d69af2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f977236b-3965-4e30-813d-db8aa0077052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f977236b-3965-4e30-813d-db8aa0077052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e100bc-f9bb-434a-9aa0-a49bfc28773a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e100bc-f9bb-434a-9aa0-a49bfc28773a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db7104df-3cfa-4fc2-94cb-ea318564cf66', 'volume_name': 'volume-db7104df-3cfa-4fc2-94cb-ea318564cf66', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40608b7d-5cc2-4cde-be4b-c81a50bc2553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40608b7d-5cc2-4cde-be4b-c81a50bc2553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d389595-ef44-4215-834d-1fd4cf2aac2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:18 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Volume db7104df-3cfa-4fc2-94cb-ea318564cf66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db7104df-3cfa-4fc2-94cb-ea318564cf66', 'volume_size': 1}
Jun 26 05:48:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:18 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3 1G" returned: 0 in 1.298s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:18 devstack sudo[101256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3
Jun 26 05:48:18 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:19 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3" returned: 0 in 0.833s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:19 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3 is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 05:48:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:19 devstack sudo[101264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3
Jun 26 05:48:19 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:20 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3" returned: 0 in 0.663s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:20 devstack sudo[101268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.info
Jun 26 05:48:20 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:20 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.info" returned: 0 in 0.654s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:20 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 05:48:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:20 devstack sudo[101271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.info
Jun 26 05:48:20 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:21 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.info" returned: 0 in 0.674s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:21 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Acquiring lock "cinder-quobyte-8d09d7fd-6abe-4032-a1f8-0c3899058f98" by "_copy_volume_from_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:48:21 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Lock "cinder-quobyte-8d09d7fd-6abe-4032-a1f8-0c3899058f98" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:48:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] snapshot: 05e171a0-bac7-4528-8039-b83e213dc6e3, volume: 8d09d7fd-6abe-4032-a1f8-0c3899058f98,  {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 05:48:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:48:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:48:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:21 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[0116aa54-4863-4de8-a0f6-89dc95852163]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:48:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:21 devstack sudo[101275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3
Jun 26 05:48:21 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:22 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3" returned: 0 in 0.759s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:22 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:48:22 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 05:48:22 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Creating direct copy from snapshot {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 05:48:22 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0efc9b-f2af-4997-9bef-76630f6b2e43]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:48:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:22 devstack sudo[101280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a
Jun 26 05:48:22 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:23 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a" returned: 0 in 0.793s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:23 devstack cinder-volume[93708]: DEBUG cinder.utils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Path /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d09d7fd-6abe-4032-a1f8-0c3899058f98 not found in is_blk_device check {{(pid=93708) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 05:48:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d09d7fd-6abe-4032-a1f8-0c3899058f98 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:23 devstack sudo[101321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d09d7fd-6abe-4032-a1f8-0c3899058f98
Jun 26 05:48:23 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:29 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d09d7fd-6abe-4032-a1f8-0c3899058f98" returned: 0 in 5.845s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:29 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[6465c54b-e903-4861-aecc-d940d7221a6b]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:48:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:29 devstack sudo[101442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a
Jun 26 05:48:29 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:30 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a" returned: 0 in 0.963s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:30 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Image conversion details: src /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d09d7fd-6abe-4032-a1f8-0c3899058f98 {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 05:48:30 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Converted 1024.00 MB image at 175.13 MB/s
Jun 26 05:48:30 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d09d7fd-6abe-4032-a1f8-0c3899058f98 is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 05:48:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d09d7fd-6abe-4032-a1f8-0c3899058f98 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:30 devstack sudo[101772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d09d7fd-6abe-4032-a1f8-0c3899058f98
Jun 26 05:48:30 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:30 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=121,cinder:SELECT=117,cinder:INSERT=34,cinder:DELETE=6 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:48:30 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=109,cinder:UPDATE=115,cinder:INSERT=35,cinder:DELETE=6 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:48:30 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d09d7fd-6abe-4032-a1f8-0c3899058f98" returned: 0 in 0.843s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Lock "cinder-quobyte-8d09d7fd-6abe-4032-a1f8-0c3899058f98" released by "_copy_volume_from_snapshot" :: held 9.287s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:48:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Acquiring lock "cinder-quobyte-05e171a0-bac7-4528-8039-b83e213dc6e3" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:48:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Lock "cinder-quobyte-05e171a0-bac7-4528-8039-b83e213dc6e3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:48:30 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Deleting offline snapshot 05e171a0-bac7-4528-8039-b83e213dc6e3 of volume 65c43a65-ebc1-4851-8d3b-dda9815d2c3a {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:48:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] snapshot_file for this snap is: volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:48:31 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bdaa1e-8a19-426d-8ad1-0c316c32ad97]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:48:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:31 devstack sudo[101827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3
Jun 26 05:48:31 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:32 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3" returned: 0 in 1.101s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:32 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:48:32 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f6e28f-53d2-4e13-8bd8-f5449f523026]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:48:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:32 devstack sudo[101853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a
Jun 26 05:48:32 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:33 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a" returned: 0 in 0.955s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:33 devstack sudo[101860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3
Jun 26 05:48:33 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:34 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3" returned: 0 in 0.983s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:34 devstack sudo[101866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3
Jun 26 05:48:34 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-35adeefc-22d9-423a-b7f2-ac500cb184c0 tempest-VolumesNegativeTest-959564117 None] Acquiring lock "cinder-3f58cfdc-9a80-4958-bdd3-d9eb1c522116-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:48:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-35adeefc-22d9-423a-b7f2-ac500cb184c0 tempest-VolumesNegativeTest-959564117 None] Lock "cinder-3f58cfdc-9a80-4958-bdd3-d9eb1c522116-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:48:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-35adeefc-22d9-423a-b7f2-ac500cb184c0 tempest-VolumesNegativeTest-959564117 None] Acquiring lock "cinder-quobyte-3f58cfdc-9a80-4958-bdd3-d9eb1c522116" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:48:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-35adeefc-22d9-423a-b7f2-ac500cb184c0 tempest-VolumesNegativeTest-959564117 None] Lock "cinder-quobyte-3f58cfdc-9a80-4958-bdd3-d9eb1c522116" acquired by "delete_volume" :: waited 0.019s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:48:34 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[0601f1d9-43d8-4a4a-909b-d8dbdbca765f]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:48:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-35adeefc-22d9-423a-b7f2-ac500cb184c0 tempest-VolumesNegativeTest-959564117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f58cfdc-9a80-4958-bdd3-d9eb1c522116 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:34 devstack sudo[101868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f58cfdc-9a80-4958-bdd3-d9eb1c522116
Jun 26 05:48:34 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:34 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a.05e171a0-bac7-4528-8039-b83e213dc6e3" returned: 0 in 0.805s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Lock "cinder-quobyte-05e171a0-bac7-4528-8039-b83e213dc6e3" released by "_delete_snapshot" :: held 3.978s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:48:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.190s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.518s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:34 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1698326078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7104df-3cfa-4fc2-94cb-ea318564cf66,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1f3f020714a47cba8d442ec7a1b29ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:48:18Z,use_quota=True,user_id='d7371b308d39486286f044ea06d69af2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:48:34 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Creating volume db7104df-3cfa-4fc2-94cb-ea318564cf66 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:48:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:34 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:48:34 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:48:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:34 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:48:34 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:48:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-db7104df-3cfa-4fc2-94cb-ea318564cf66 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:35 devstack sudo[101871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-db7104df-3cfa-4fc2-94cb-ea318564cf66 1073741824
Jun 26 05:48:35 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:35 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-99d70916-d917-4152-8b84-8b551a5232bf tempest-GroupsV314Test-1450158271 None] Create group from source-group-8cb498ad-6bf3-4faa-a9f7-25d9547d4dba completed successfully.
Jun 26 05:48:35 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-35adeefc-22d9-423a-b7f2-ac500cb184c0 tempest-VolumesNegativeTest-959564117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f58cfdc-9a80-4958-bdd3-d9eb1c522116" returned: 0 in 0.885s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-35adeefc-22d9-423a-b7f2-ac500cb184c0 tempest-VolumesNegativeTest-959564117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f58cfdc-9a80-4958-bdd3-d9eb1c522116 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:35 devstack sudo[101876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f58cfdc-9a80-4958-bdd3-d9eb1c522116
Jun 26 05:48:35 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8e508528-445b-43bd-9449-cd699023a767 tempest-GroupsV314Test-1450158271 None] Acquiring lock "cinder-quobyte-8d09d7fd-6abe-4032-a1f8-0c3899058f98" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:48:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8e508528-445b-43bd-9449-cd699023a767 tempest-GroupsV314Test-1450158271 None] Lock "cinder-quobyte-8d09d7fd-6abe-4032-a1f8-0c3899058f98" acquired by "delete_volume" :: waited 0.019s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:48:35 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[09731d93-af6a-4803-9d9a-f81bf56f9b18]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:48:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8e508528-445b-43bd-9449-cd699023a767 tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d09d7fd-6abe-4032-a1f8-0c3899058f98 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:36 devstack sudo[101882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d09d7fd-6abe-4032-a1f8-0c3899058f98
Jun 26 05:48:36 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:36 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-db7104df-3cfa-4fc2-94cb-ea318564cf66 1073741824" returned: 0 in 1.110s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-db7104df-3cfa-4fc2-94cb-ea318564cf66 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:36 devstack sudo[101884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-db7104df-3cfa-4fc2-94cb-ea318564cf66
Jun 26 05:48:36 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:36 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-35adeefc-22d9-423a-b7f2-ac500cb184c0 tempest-VolumesNegativeTest-959564117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f58cfdc-9a80-4958-bdd3-d9eb1c522116" returned: 0 in 0.865s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-35adeefc-22d9-423a-b7f2-ac500cb184c0 tempest-VolumesNegativeTest-959564117 None] Lock "cinder-quobyte-3f58cfdc-9a80-4958-bdd3-d9eb1c522116" released by "delete_volume" :: held 1.834s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:48:36 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-35adeefc-22d9-423a-b7f2-ac500cb184c0 tempest-VolumesNegativeTest-959564117 None] Created reservations ['37ed518d-9035-4fa6-b58e-6a8833330638', '2d2287d6-9861-4a4f-b67a-3f21bbd185a0', 'bc2bb793-411d-4c23-a9cd-128d2917edd1', '7411d50b-b710-4f59-843a-0f0430216771'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:48:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-35adeefc-22d9-423a-b7f2-ac500cb184c0 tempest-VolumesNegativeTest-959564117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-35adeefc-22d9-423a-b7f2-ac500cb184c0 tempest-VolumesNegativeTest-959564117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-35adeefc-22d9-423a-b7f2-ac500cb184c0 tempest-VolumesNegativeTest-959564117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:48:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-35adeefc-22d9-423a-b7f2-ac500cb184c0 tempest-VolumesNegativeTest-959564117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:48:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-35adeefc-22d9-423a-b7f2-ac500cb184c0 tempest-VolumesNegativeTest-959564117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-35adeefc-22d9-423a-b7f2-ac500cb184c0 tempest-VolumesNegativeTest-959564117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:36 devstack sudo[101887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:48:36 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:36 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-db7104df-3cfa-4fc2-94cb-ea318564cf66" returned: 0 in 0.722s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:48:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:36 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8e508528-445b-43bd-9449-cd699023a767 tempest-GroupsV314Test-1450158271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d09d7fd-6abe-4032-a1f8-0c3899058f98" returned: 0 in 0.955s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8e508528-445b-43bd-9449-cd699023a767 tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d09d7fd-6abe-4032-a1f8-0c3899058f98 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d389595-ef44-4215-834d-1fd4cf2aac2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db7104df-3cfa-4fc2-94cb-ea318564cf66', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa62ea4-846e-4e73-ab66-f0e8a213ea60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:36 devstack sudo[101893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d09d7fd-6abe-4032-a1f8-0c3899058f98
Jun 26 05:48:36 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:36 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Volume volume-db7104df-3cfa-4fc2-94cb-ea318564cf66 (db7104df-3cfa-4fc2-94cb-ea318564cf66): created successfully
Jun 26 05:48:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa62ea4-846e-4e73-ab66-f0e8a213ea60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Flow 'volume_create_manager' (6e42ac5a-a6fd-4252-ba35-a444e59108ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:48:36 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-aa77136b-6d4c-4707-a93a-976efe530662 req-8d5eb59d-905d-40cb-82db-7f3fb8df2a0d tempest-VolumesGetTestJSON-1173195721 None] Created volume successfully.
Jun 26 05:48:37 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-35adeefc-22d9-423a-b7f2-ac500cb184c0 tempest-VolumesNegativeTest-959564117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.918s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:37 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-35adeefc-22d9-423a-b7f2-ac500cb184c0 tempest-VolumesNegativeTest-959564117 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:48:37 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-35adeefc-22d9-423a-b7f2-ac500cb184c0 tempest-VolumesNegativeTest-959564117 None] Deleted volume successfully.
Jun 26 05:48:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-35adeefc-22d9-423a-b7f2-ac500cb184c0 tempest-VolumesNegativeTest-959564117 None] Lock "cinder-3f58cfdc-9a80-4958-bdd3-d9eb1c522116-delete_volume" released by "delete_volume" :: held 2.977s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:48:37 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8e508528-445b-43bd-9449-cd699023a767 tempest-GroupsV314Test-1450158271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d09d7fd-6abe-4032-a1f8-0c3899058f98" returned: 0 in 0.885s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8e508528-445b-43bd-9449-cd699023a767 tempest-GroupsV314Test-1450158271 None] Lock "cinder-quobyte-8d09d7fd-6abe-4032-a1f8-0c3899058f98" released by "delete_volume" :: held 1.901s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:48:37 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-8e508528-445b-43bd-9449-cd699023a767 tempest-GroupsV314Test-1450158271 None] Created reservations ['fa052718-3987-4f62-a9b9-f9ce44105e7e'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:48:37 devstack cinder-volume[93708]: WARNING cinder.quota [None req-8e508528-445b-43bd-9449-cd699023a767 tempest-GroupsV314Test-1450158271 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-469579523 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-469579523, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:48:37 devstack cinder-volume[93708]: WARNING cinder.quota [None req-8e508528-445b-43bd-9449-cd699023a767 tempest-GroupsV314Test-1450158271 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-469579523 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-469579523, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:48:37 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-8e508528-445b-43bd-9449-cd699023a767 tempest-GroupsV314Test-1450158271 None] Created reservations ['99eff7b6-bfc2-4f23-b264-40cc4ae52e31', 'a4e52e8d-a739-4afa-9d6a-9de83a18264c', '167643ce-2b10-42b2-99fa-0261b0a23058', 'e05e0934-a09a-41f3-9981-61d3b1db8e15'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:48:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8e508528-445b-43bd-9449-cd699023a767 tempest-GroupsV314Test-1450158271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8e508528-445b-43bd-9449-cd699023a767 tempest-GroupsV314Test-1450158271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:38 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8e508528-445b-43bd-9449-cd699023a767 tempest-GroupsV314Test-1450158271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:48:38 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8e508528-445b-43bd-9449-cd699023a767 tempest-GroupsV314Test-1450158271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:48:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8e508528-445b-43bd-9449-cd699023a767 tempest-GroupsV314Test-1450158271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8e508528-445b-43bd-9449-cd699023a767 tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:38 devstack sudo[101897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:48:38 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-d5a3aad5-6fc2-4ce1-b029-7e1e98190192 req-a26a4efa-10ac-4690-b15e-0b0762540cb2 tempest-VolumesGetTestJSON-1173195721 None] Acquiring lock "cinder-db7104df-3cfa-4fc2-94cb-ea318564cf66-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:48:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-d5a3aad5-6fc2-4ce1-b029-7e1e98190192 req-a26a4efa-10ac-4690-b15e-0b0762540cb2 tempest-VolumesGetTestJSON-1173195721 None] Lock "cinder-db7104df-3cfa-4fc2-94cb-ea318564cf66-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:48:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-d5a3aad5-6fc2-4ce1-b029-7e1e98190192 req-a26a4efa-10ac-4690-b15e-0b0762540cb2 tempest-VolumesGetTestJSON-1173195721 None] Acquiring lock "cinder-quobyte-db7104df-3cfa-4fc2-94cb-ea318564cf66" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:48:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-d5a3aad5-6fc2-4ce1-b029-7e1e98190192 req-a26a4efa-10ac-4690-b15e-0b0762540cb2 tempest-VolumesGetTestJSON-1173195721 None] Lock "cinder-quobyte-db7104df-3cfa-4fc2-94cb-ea318564cf66" acquired by "delete_volume" :: waited 0.040s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:48:38 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbaccc4-eceb-4c20-841e-98b96c8f7b48]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:48:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-d5a3aad5-6fc2-4ce1-b029-7e1e98190192 req-a26a4efa-10ac-4690-b15e-0b0762540cb2 tempest-VolumesGetTestJSON-1173195721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-db7104df-3cfa-4fc2-94cb-ea318564cf66 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:38 devstack sudo[101899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-db7104df-3cfa-4fc2-94cb-ea318564cf66
Jun 26 05:48:38 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-28a155da-b1aa-4716-917d-fef398d5b028 tempest-GroupsV314Test-1450158271 None] Acquiring lock "cinder-quobyte-65c43a65-ebc1-4851-8d3b-dda9815d2c3a" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:48:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-28a155da-b1aa-4716-917d-fef398d5b028 tempest-GroupsV314Test-1450158271 None] Lock "cinder-quobyte-65c43a65-ebc1-4851-8d3b-dda9815d2c3a" acquired by "delete_volume" :: waited 0.030s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:48:39 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[935dd544-9865-4e72-94ae-d5aa0c85a8e9]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:48:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-28a155da-b1aa-4716-917d-fef398d5b028 tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:39 devstack sudo[101901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a
Jun 26 05:48:39 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:39 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8e508528-445b-43bd-9449-cd699023a767 tempest-GroupsV314Test-1450158271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.705s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:39 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-8e508528-445b-43bd-9449-cd699023a767 tempest-GroupsV314Test-1450158271 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:48:39 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-8e508528-445b-43bd-9449-cd699023a767 tempest-GroupsV314Test-1450158271 None] Delete group completed successfully.
Jun 26 05:48:40 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-d5a3aad5-6fc2-4ce1-b029-7e1e98190192 req-a26a4efa-10ac-4690-b15e-0b0762540cb2 tempest-VolumesGetTestJSON-1173195721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-db7104df-3cfa-4fc2-94cb-ea318564cf66" returned: 0 in 1.450s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-d5a3aad5-6fc2-4ce1-b029-7e1e98190192 req-a26a4efa-10ac-4690-b15e-0b0762540cb2 tempest-VolumesGetTestJSON-1173195721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-db7104df-3cfa-4fc2-94cb-ea318564cf66 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:40 devstack sudo[101907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-db7104df-3cfa-4fc2-94cb-ea318564cf66
Jun 26 05:48:40 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:40 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-28a155da-b1aa-4716-917d-fef398d5b028 tempest-GroupsV314Test-1450158271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a" returned: 0 in 1.513s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-28a155da-b1aa-4716-917d-fef398d5b028 tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:40 devstack sudo[101912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a
Jun 26 05:48:40 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:41 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-d5a3aad5-6fc2-4ce1-b029-7e1e98190192 req-a26a4efa-10ac-4690-b15e-0b0762540cb2 tempest-VolumesGetTestJSON-1173195721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-db7104df-3cfa-4fc2-94cb-ea318564cf66" returned: 0 in 0.948s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-d5a3aad5-6fc2-4ce1-b029-7e1e98190192 req-a26a4efa-10ac-4690-b15e-0b0762540cb2 tempest-VolumesGetTestJSON-1173195721 None] Lock "cinder-quobyte-db7104df-3cfa-4fc2-94cb-ea318564cf66" released by "delete_volume" :: held 2.498s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.quota [req-d5a3aad5-6fc2-4ce1-b029-7e1e98190192 req-a26a4efa-10ac-4690-b15e-0b0762540cb2 tempest-VolumesGetTestJSON-1173195721 None] Created reservations ['83772646-2c69-4f8c-bb8a-7f1675e886f8', '9efa4737-f368-401b-97d5-0810fb91a06c', 'fd288ffb-9c3c-4808-888c-b00e1443ceb4', 'f58fbdac-4a94-4fa9-b610-a6ff1b8bbf8c'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-d5a3aad5-6fc2-4ce1-b029-7e1e98190192 req-a26a4efa-10ac-4690-b15e-0b0762540cb2 tempest-VolumesGetTestJSON-1173195721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-d5a3aad5-6fc2-4ce1-b029-7e1e98190192 req-a26a4efa-10ac-4690-b15e-0b0762540cb2 tempest-VolumesGetTestJSON-1173195721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [req-d5a3aad5-6fc2-4ce1-b029-7e1e98190192 req-a26a4efa-10ac-4690-b15e-0b0762540cb2 tempest-VolumesGetTestJSON-1173195721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [req-d5a3aad5-6fc2-4ce1-b029-7e1e98190192 req-a26a4efa-10ac-4690-b15e-0b0762540cb2 tempest-VolumesGetTestJSON-1173195721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-d5a3aad5-6fc2-4ce1-b029-7e1e98190192 req-a26a4efa-10ac-4690-b15e-0b0762540cb2 tempest-VolumesGetTestJSON-1173195721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-d5a3aad5-6fc2-4ce1-b029-7e1e98190192 req-a26a4efa-10ac-4690-b15e-0b0762540cb2 tempest-VolumesGetTestJSON-1173195721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:41 devstack sudo[101915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:48:41 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Flow 'volume_create_manager' (eb52fb59-7044-4caf-9794-aaf1c9db6731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a767d34-36a5-4085-a215-a310ca2e5dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a767d34-36a5-4085-a215-a310ca2e5dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1608416741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08921111-cd52-4fbd-863f-c69d12fe30b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17a9a5c7d83d4ddfb55c6baa6746d043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:48:41Z,use_quota=True,user_id='dab219a393bc4039b372822525b33495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e049313-2d84-408e-b1e2-5a8a4a807833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e049313-2d84-408e-b1e2-5a8a4a807833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15af42a9-d854-4c72-b8bd-f129f27c6b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15af42a9-d854-4c72-b8bd-f129f27c6b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08921111-cd52-4fbd-863f-c69d12fe30b9', 'volume_name': 'volume-08921111-cd52-4fbd-863f-c69d12fe30b9', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a92117e-bad2-4296-ba41-2af25546d5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:41 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a92117e-bad2-4296-ba41-2af25546d5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6f8eb2-f9f0-4472-ba8f-825f22b911cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:41 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Volume 08921111-cd52-4fbd-863f-c69d12fe30b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08921111-cd52-4fbd-863f-c69d12fe30b9', 'volume_size': 1}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1608416741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08921111-cd52-4fbd-863f-c69d12fe30b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17a9a5c7d83d4ddfb55c6baa6746d043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:48:41Z,use_quota=True,user_id='dab219a393bc4039b372822525b33495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Creating volume 08921111-cd52-4fbd-863f-c69d12fe30b9 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:48:41 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-28a155da-b1aa-4716-917d-fef398d5b028 tempest-GroupsV314Test-1450158271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-65c43a65-ebc1-4851-8d3b-dda9815d2c3a" returned: 0 in 0.893s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-28a155da-b1aa-4716-917d-fef398d5b028 tempest-GroupsV314Test-1450158271 None] Lock "cinder-quobyte-65c43a65-ebc1-4851-8d3b-dda9815d2c3a" released by "delete_volume" :: held 2.526s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:48:41 devstack sudo[101919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9 1073741824
Jun 26 05:48:41 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-28a155da-b1aa-4716-917d-fef398d5b028 tempest-GroupsV314Test-1450158271 None] Created reservations ['d3b52936-71c5-4ac3-b182-5d3d0c69a0e1'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:48:41 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-28a155da-b1aa-4716-917d-fef398d5b028 tempest-GroupsV314Test-1450158271 None] Created reservations ['1befa1e4-a3d8-4301-b350-a6bee4a5d193', 'a6a18471-508a-4b99-ae2a-8bccca8abfc8', '0355c0a4-1cde-4e01-bff1-361f57d6a88e', '0eb63684-6a45-487e-98eb-a56fdfeabf97'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:48:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-28a155da-b1aa-4716-917d-fef398d5b028 tempest-GroupsV314Test-1450158271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-28a155da-b1aa-4716-917d-fef398d5b028 tempest-GroupsV314Test-1450158271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-28a155da-b1aa-4716-917d-fef398d5b028 tempest-GroupsV314Test-1450158271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:48:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-28a155da-b1aa-4716-917d-fef398d5b028 tempest-GroupsV314Test-1450158271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:48:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-28a155da-b1aa-4716-917d-fef398d5b028 tempest-GroupsV314Test-1450158271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-28a155da-b1aa-4716-917d-fef398d5b028 tempest-GroupsV314Test-1450158271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:42 devstack sudo[101922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:48:42 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:42 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-d5a3aad5-6fc2-4ce1-b029-7e1e98190192 req-a26a4efa-10ac-4690-b15e-0b0762540cb2 tempest-VolumesGetTestJSON-1173195721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.968s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:42 devstack cinder-volume[93708]: DEBUG cinder.manager [req-d5a3aad5-6fc2-4ce1-b029-7e1e98190192 req-a26a4efa-10ac-4690-b15e-0b0762540cb2 tempest-VolumesGetTestJSON-1173195721 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:48:42 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-d5a3aad5-6fc2-4ce1-b029-7e1e98190192 req-a26a4efa-10ac-4690-b15e-0b0762540cb2 tempest-VolumesGetTestJSON-1173195721 None] Deleted volume successfully.
Jun 26 05:48:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-d5a3aad5-6fc2-4ce1-b029-7e1e98190192 req-a26a4efa-10ac-4690-b15e-0b0762540cb2 tempest-VolumesGetTestJSON-1173195721 None] Lock "cinder-db7104df-3cfa-4fc2-94cb-ea318564cf66-delete_volume" released by "delete_volume" :: held 3.843s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:48:42 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-28a155da-b1aa-4716-917d-fef398d5b028 tempest-GroupsV314Test-1450158271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.852s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:43 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-28a155da-b1aa-4716-917d-fef398d5b028 tempest-GroupsV314Test-1450158271 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:48:43 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9 1073741824" returned: 0 in 1.337s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:43 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-28a155da-b1aa-4716-917d-fef398d5b028 tempest-GroupsV314Test-1450158271 None] Delete group completed successfully.
Jun 26 05:48:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:43 devstack sudo[101929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9
Jun 26 05:48:43 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:43 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9" returned: 0 in 0.838s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:43 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] <== create_volume: return (2252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:48:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.256s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:43 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6f8eb2-f9f0-4472-ba8f-825f22b911cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08921111-cd52-4fbd-863f-c69d12fe30b9', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:43 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec82122d-4116-4829-8595-efe7e43583fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:44 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Volume volume-08921111-cd52-4fbd-863f-c69d12fe30b9 (08921111-cd52-4fbd-863f-c69d12fe30b9): created successfully
Jun 26 05:48:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec82122d-4116-4829-8595-efe7e43583fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Flow 'volume_create_manager' (eb52fb59-7044-4caf-9794-aaf1c9db6731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:48:44 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-225efc4b-5dfd-4601-86cd-85e0bf4258cd tempest-VolumesSnapshotListTestJSON-1134578390 None] Created volume successfully.
Jun 26 05:48:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f5a84cf1-6b37-4f27-84f9-6465c11728c1 tempest-VolumesSnapshotListTestJSON-1134578390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f5a84cf1-6b37-4f27-84f9-6465c11728c1 tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-f5a84cf1-6b37-4f27-84f9-6465c11728c1 tempest-VolumesSnapshotListTestJSON-1134578390 None] Creating offline snapshot 4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8 of volume 08921111-cd52-4fbd-863f-c69d12fe30b9 {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:48:45 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34d1e0e-d653-45cd-b452-a0b3d5a0ed45]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:48:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f5a84cf1-6b37-4f27-84f9-6465c11728c1 tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:45 devstack sudo[101950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9
Jun 26 05:48:45 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:46 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f5a84cf1-6b37-4f27-84f9-6465c11728c1 tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9" returned: 0 in 0.982s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f5a84cf1-6b37-4f27-84f9-6465c11728c1 tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:46 devstack sudo[101981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8 1G
Jun 26 05:48:46 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:46 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:48:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Flow 'volume_create_manager' (fbf39d8b-40c0-432d-8ae6-62d8f8cdeb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:48:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209bfbd0-f994-497e-8931-65f9c5be740a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209bfbd0-f994-497e-8931-65f9c5be740a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1585187469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07bd1b1f-b503-4dcf-be7f-15b16a9b180f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4cd9f998489d4bc58f432e4a9a5eaebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:48:47Z,use_quota=True,user_id='a7d9feeb46af4af48502e10f4d9a7862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04bed79a-29bc-44de-bc15-c2777058f318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04bed79a-29bc-44de-bc15-c2777058f318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bbd5a29-f14c-4b76-a937-5bc86b760f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bbd5a29-f14c-4b76-a937-5bc86b760f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07bd1b1f-b503-4dcf-be7f-15b16a9b180f', 'volume_name': 'volume-07bd1b1f-b503-4dcf-be7f-15b16a9b180f', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61669720-1832-4272-b1e6-37ded0c913c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61669720-1832-4272-b1e6-37ded0c913c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f1483f-a8d4-46e4-83f8-1efb60bad7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:46 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Volume 07bd1b1f-b503-4dcf-be7f-15b16a9b180f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07bd1b1f-b503-4dcf-be7f-15b16a9b180f', 'volume_size': 1}
Jun 26 05:48:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:47 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f5a84cf1-6b37-4f27-84f9-6465c11728c1 tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8 1G" returned: 0 in 0.971s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f5a84cf1-6b37-4f27-84f9-6465c11728c1 tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08921111-cd52-4fbd-863f-c69d12fe30b9 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:47 devstack sudo[101987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08921111-cd52-4fbd-863f-c69d12fe30b9 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8
Jun 26 05:48:47 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:47 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f5a84cf1-6b37-4f27-84f9-6465c11728c1 tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08921111-cd52-4fbd-863f-c69d12fe30b9 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8" returned: 0 in 0.712s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:47 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-f5a84cf1-6b37-4f27-84f9-6465c11728c1 tempest-VolumesSnapshotListTestJSON-1134578390 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8 is being set with open permissions: ugo+rw
Jun 26 05:48:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f5a84cf1-6b37-4f27-84f9-6465c11728c1 tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:47 devstack sudo[101993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8
Jun 26 05:48:47 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:48 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f5a84cf1-6b37-4f27-84f9-6465c11728c1 tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8" returned: 0 in 0.658s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f5a84cf1-6b37-4f27-84f9-6465c11728c1 tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:48 devstack sudo[101996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.info
Jun 26 05:48:48 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:49 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-c544bdcb-d13b-4f7a-913a-33de70aa6aba tempest-GroupsV320Test-1394359149 None] Group tempest-GroupsV320Test-Group-776250773: creating
Jun 26 05:48:49 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-c544bdcb-d13b-4f7a-913a-33de70aa6aba tempest-GroupsV320Test-1394359149 None] Group tempest-GroupsV320Test-Group-776250773: created successfully
Jun 26 05:48:49 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-c544bdcb-d13b-4f7a-913a-33de70aa6aba tempest-GroupsV320Test-1394359149 None] Create group completed successfully.
Jun 26 05:48:49 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f5a84cf1-6b37-4f27-84f9-6465c11728c1 tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.info" returned: 0 in 0.703s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:49 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-f5a84cf1-6b37-4f27-84f9-6465c11728c1 tempest-VolumesSnapshotListTestJSON-1134578390 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.info is being set with open permissions: ugo+rw
Jun 26 05:48:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f5a84cf1-6b37-4f27-84f9-6465c11728c1 tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:49 devstack sudo[101999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.info
Jun 26 05:48:49 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:49 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f5a84cf1-6b37-4f27-84f9-6465c11728c1 tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.info" returned: 0 in 0.652s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f5a84cf1-6b37-4f27-84f9-6465c11728c1 tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.790s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.967s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:49 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1585187469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07bd1b1f-b503-4dcf-be7f-15b16a9b180f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4cd9f998489d4bc58f432e4a9a5eaebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:48:47Z,use_quota=True,user_id='a7d9feeb46af4af48502e10f4d9a7862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:48:49 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Creating volume 07bd1b1f-b503-4dcf-be7f-15b16a9b180f {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:48:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:49 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:48:49 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:48:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:49 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:48:49 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:48:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-07bd1b1f-b503-4dcf-be7f-15b16a9b180f 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:49 devstack sudo[102002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-07bd1b1f-b503-4dcf-be7f-15b16a9b180f 1073741824
Jun 26 05:48:49 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:49 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-f5a84cf1-6b37-4f27-84f9-6465c11728c1 tempest-VolumesSnapshotListTestJSON-1134578390 None] Create snapshot completed successfully
Jun 26 05:48:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-046d10e1-7e8b-430a-8b77-eb7ef2b846b9 tempest-VolumesSnapshotListTestJSON-1134578390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:50 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-226e44f8-4fcc-4502-ae22-b372c51a152f tempest-GroupsV320Test-1394359149 None] Created reservations ['c4cbec15-b8ae-48c7-891f-67d314505858'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:48:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-226e44f8-4fcc-4502-ae22-b372c51a152f tempest-GroupsV320Test-1394359149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-226e44f8-4fcc-4502-ae22-b372c51a152f tempest-GroupsV320Test-1394359149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:50 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-226e44f8-4fcc-4502-ae22-b372c51a152f tempest-GroupsV320Test-1394359149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:48:50 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-226e44f8-4fcc-4502-ae22-b372c51a152f tempest-GroupsV320Test-1394359149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:48:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-226e44f8-4fcc-4502-ae22-b372c51a152f tempest-GroupsV320Test-1394359149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-226e44f8-4fcc-4502-ae22-b372c51a152f tempest-GroupsV320Test-1394359149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:50 devstack sudo[102007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:48:50 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:50 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-07bd1b1f-b503-4dcf-be7f-15b16a9b180f 1073741824" returned: 0 in 0.895s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-07bd1b1f-b503-4dcf-be7f-15b16a9b180f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:50 devstack sudo[102009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-07bd1b1f-b503-4dcf-be7f-15b16a9b180f
Jun 26 05:48:50 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:51 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-226e44f8-4fcc-4502-ae22-b372c51a152f tempest-GroupsV320Test-1394359149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.652s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:51 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-226e44f8-4fcc-4502-ae22-b372c51a152f tempest-GroupsV320Test-1394359149 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:48:51 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-226e44f8-4fcc-4502-ae22-b372c51a152f tempest-GroupsV320Test-1394359149 None] Delete group completed successfully.
Jun 26 05:48:51 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-07bd1b1f-b503-4dcf-be7f-15b16a9b180f" returned: 0 in 0.679s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:48:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-046d10e1-7e8b-430a-8b77-eb7ef2b846b9 tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.025s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-046d10e1-7e8b-430a-8b77-eb7ef2b846b9 tempest-VolumesSnapshotListTestJSON-1134578390 None] Creating offline snapshot 345d05e2-a9e1-4494-b013-c43cd5e060a6 of volume 08921111-cd52-4fbd-863f-c69d12fe30b9 {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:48:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f1483f-a8d4-46e4-83f8-1efb60bad7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07bd1b1f-b503-4dcf-be7f-15b16a9b180f', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d789ecf8-e068-4a6f-b3ca-c39e935d7305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:51 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[06777d42-2102-41b6-a57b-9579b51212ec]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:48:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-046d10e1-7e8b-430a-8b77-eb7ef2b846b9 tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:51 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Volume volume-07bd1b1f-b503-4dcf-be7f-15b16a9b180f (07bd1b1f-b503-4dcf-be7f-15b16a9b180f): created successfully
Jun 26 05:48:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d789ecf8-e068-4a6f-b3ca-c39e935d7305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Flow 'volume_create_manager' (fbf39d8b-40c0-432d-8ae6-62d8f8cdeb29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:48:51 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-45586b56-10ea-43a0-b2fc-e2ffd0077898 tempest-VolumesTestJSON-835837134 None] Created volume successfully.
Jun 26 05:48:51 devstack sudo[102014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8
Jun 26 05:48:51 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:52 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-046d10e1-7e8b-430a-8b77-eb7ef2b846b9 tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8" returned: 0 in 0.924s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:52 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-046d10e1-7e8b-430a-8b77-eb7ef2b846b9 tempest-VolumesSnapshotListTestJSON-1134578390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08921111-cd52-4fbd-863f-c69d12fe30b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:48:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-046d10e1-7e8b-430a-8b77-eb7ef2b846b9 tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:52 devstack sudo[102020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6 1G
Jun 26 05:48:52 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:53 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:48:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Flow 'volume_create_manager' (80f32d04-513a-49c1-a356-36bd028ded4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:48:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c592266-ba20-446f-9d94-7047104e6d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c592266-ba20-446f-9d94-7047104e6d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-775459145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bae0e5d-6c68-4e31-b7de-c31eb204b594,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4cd9f998489d4bc58f432e4a9a5eaebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:48:53Z,use_quota=True,user_id='a7d9feeb46af4af48502e10f4d9a7862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a531e6c-e255-4e53-9858-e6676d2aca66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a531e6c-e255-4e53-9858-e6676d2aca66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ed7665-2511-4fe4-8652-8d94ca8eee82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ed7665-2511-4fe4-8652-8d94ca8eee82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bae0e5d-6c68-4e31-b7de-c31eb204b594', 'volume_name': 'volume-1bae0e5d-6c68-4e31-b7de-c31eb204b594', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6834e83a-3f03-4b81-a275-ad043239c3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6834e83a-3f03-4b81-a275-ad043239c3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99874c40-83f3-4eb7-ba95-51cab08ba7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:53 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Volume 1bae0e5d-6c68-4e31-b7de-c31eb204b594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bae0e5d-6c68-4e31-b7de-c31eb204b594', 'volume_size': 1}
Jun 26 05:48:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:53 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-046d10e1-7e8b-430a-8b77-eb7ef2b846b9 tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6 1G" returned: 0 in 1.033s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-046d10e1-7e8b-430a-8b77-eb7ef2b846b9 tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:53 devstack sudo[102027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6
Jun 26 05:48:53 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:54 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-046d10e1-7e8b-430a-8b77-eb7ef2b846b9 tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6" returned: 0 in 0.800s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:54 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-046d10e1-7e8b-430a-8b77-eb7ef2b846b9 tempest-VolumesSnapshotListTestJSON-1134578390 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6 is being set with open permissions: ugo+rw
Jun 26 05:48:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-046d10e1-7e8b-430a-8b77-eb7ef2b846b9 tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:54 devstack sudo[102035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6
Jun 26 05:48:54 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:55 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-046d10e1-7e8b-430a-8b77-eb7ef2b846b9 tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6" returned: 0 in 0.763s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-046d10e1-7e8b-430a-8b77-eb7ef2b846b9 tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.621s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.078s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:55 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-775459145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bae0e5d-6c68-4e31-b7de-c31eb204b594,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4cd9f998489d4bc58f432e4a9a5eaebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:48:53Z,use_quota=True,user_id='a7d9feeb46af4af48502e10f4d9a7862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:48:55 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Creating volume 1bae0e5d-6c68-4e31-b7de-c31eb204b594 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:48:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:55 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:48:55 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:48:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:55 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:48:55 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:48:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1bae0e5d-6c68-4e31-b7de-c31eb204b594 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:55 devstack sudo[102045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1bae0e5d-6c68-4e31-b7de-c31eb204b594 1073741824
Jun 26 05:48:55 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:55 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-046d10e1-7e8b-430a-8b77-eb7ef2b846b9 tempest-VolumesSnapshotListTestJSON-1134578390 None] Create snapshot completed successfully
Jun 26 05:48:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2ca20e35-6d32-49cd-b987-c18361b0fcef tempest-VolumesSnapshotListTestJSON-1134578390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:56 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-94fdd9ea-60d2-4970-be3e-529ee2cfb662 req-32a19785-4d2f-43f7-be6c-e3dd3db0160c tempest-AttachVolumeTestJSON-1893104206 None] Terminate volume connection completed successfully.
Jun 26 05:48:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-94fdd9ea-60d2-4970-be3e-529ee2cfb662 req-32a19785-4d2f-43f7-be6c-e3dd3db0160c tempest-AttachVolumeTestJSON-1893104206 None] Deleting attachment 9d71c63f-85fd-46d6-9699-69394b3a17cf. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 05:48:56 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1bae0e5d-6c68-4e31-b7de-c31eb204b594 1073741824" returned: 0 in 1.068s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1bae0e5d-6c68-4e31-b7de-c31eb204b594 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:56 devstack sudo[102057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1bae0e5d-6c68-4e31-b7de-c31eb204b594
Jun 26 05:48:56 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:56 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1bae0e5d-6c68-4e31-b7de-c31eb204b594" returned: 0 in 0.650s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:48:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:48:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2ca20e35-6d32-49cd-b987-c18361b0fcef tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.912s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:48:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-2ca20e35-6d32-49cd-b987-c18361b0fcef tempest-VolumesSnapshotListTestJSON-1134578390 None] Creating offline snapshot aa067891-3a74-4f74-b55a-63ff67ab3f96 of volume 08921111-cd52-4fbd-863f-c69d12fe30b9 {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:48:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99874c40-83f3-4eb7-ba95-51cab08ba7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bae0e5d-6c68-4e31-b7de-c31eb204b594', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b8939d4-a133-4133-a56a-537eeac4a198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:57 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c52ba9-8c0a-4d5d-9e5d-c6fcdb368de8]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:48:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2ca20e35-6d32-49cd-b987-c18361b0fcef tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:57 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Volume volume-1bae0e5d-6c68-4e31-b7de-c31eb204b594 (1bae0e5d-6c68-4e31-b7de-c31eb204b594): created successfully
Jun 26 05:48:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b8939d4-a133-4133-a56a-537eeac4a198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Flow 'volume_create_manager' (80f32d04-513a-49c1-a356-36bd028ded4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:48:57 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-22625b21-c996-4614-bd60-9b0da12e6c3f tempest-VolumesTestJSON-835837134 None] Created volume successfully.
Jun 26 05:48:57 devstack sudo[102060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6
Jun 26 05:48:57 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:57 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:48:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Flow 'volume_create_manager' (fe689b9b-3fd7-4a26-992b-7a30c000f2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:48:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e35c690-034b-4a9b-80a9-dfa4f4c62e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:57 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e35c690-034b-4a9b-80a9-dfa4f4c62e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-265877998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=963fbcc1-ef9c-48bf-840a-d4e598bfd028,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4cd9f998489d4bc58f432e4a9a5eaebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:48:58Z,use_quota=True,user_id='a7d9feeb46af4af48502e10f4d9a7862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b61e33-3551-4b4d-b14b-bb40474d9078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b61e33-3551-4b4d-b14b-bb40474d9078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467acbac-1c93-4a60-9631-d617b52f9022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467acbac-1c93-4a60-9631-d617b52f9022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '963fbcc1-ef9c-48bf-840a-d4e598bfd028', 'volume_name': 'volume-963fbcc1-ef9c-48bf-840a-d4e598bfd028', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5b8da2-2f7a-4ba0-ab3f-0cfe2c5e1930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5b8da2-2f7a-4ba0-ab3f-0cfe2c5e1930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:48:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96a2663-d1fe-40e8-97c3-787572656340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:48:58 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Volume 963fbcc1-ef9c-48bf-840a-d4e598bfd028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-963fbcc1-ef9c-48bf-840a-d4e598bfd028', 'volume_size': 1}
Jun 26 05:48:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:48:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2ca20e35-6d32-49cd-b987-c18361b0fcef tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6" returned: 0 in 1.035s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-2ca20e35-6d32-49cd-b987-c18361b0fcef tempest-VolumesSnapshotListTestJSON-1134578390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08921111-cd52-4fbd-863f-c69d12fe30b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:48:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2ca20e35-6d32-49cd-b987-c18361b0fcef tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.aa067891-3a74-4f74-b55a-63ff67ab3f96 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:58 devstack sudo[102069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.aa067891-3a74-4f74-b55a-63ff67ab3f96 1G
Jun 26 05:48:58 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:59 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2ca20e35-6d32-49cd-b987-c18361b0fcef tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.aa067891-3a74-4f74-b55a-63ff67ab3f96 1G" returned: 0 in 0.981s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2ca20e35-6d32-49cd-b987-c18361b0fcef tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.aa067891-3a74-4f74-b55a-63ff67ab3f96 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:48:59 devstack sudo[102075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.aa067891-3a74-4f74-b55a-63ff67ab3f96
Jun 26 05:48:59 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:48:59 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root
Jun 26 05:48:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2ca20e35-6d32-49cd-b987-c18361b0fcef tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.aa067891-3a74-4f74-b55a-63ff67ab3f96" returned: 0 in 0.960s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:48:59 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-2ca20e35-6d32-49cd-b987-c18361b0fcef tempest-VolumesSnapshotListTestJSON-1134578390 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.aa067891-3a74-4f74-b55a-63ff67ab3f96 is being set with open permissions: ugo+rw
Jun 26 05:48:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2ca20e35-6d32-49cd-b987-c18361b0fcef tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.aa067891-3a74-4f74-b55a-63ff67ab3f96 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:00 devstack sudo[102125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.aa067891-3a74-4f74-b55a-63ff67ab3f96
Jun 26 05:49:00 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:00 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2ca20e35-6d32-49cd-b987-c18361b0fcef tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.aa067891-3a74-4f74-b55a-63ff67ab3f96" returned: 0 in 0.736s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2ca20e35-6d32-49cd-b987-c18361b0fcef tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.821s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.723s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:00 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-265877998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=963fbcc1-ef9c-48bf-840a-d4e598bfd028,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4cd9f998489d4bc58f432e4a9a5eaebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:48:58Z,use_quota=True,user_id='a7d9feeb46af4af48502e10f4d9a7862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:49:00 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Creating volume 963fbcc1-ef9c-48bf-840a-d4e598bfd028 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:49:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:00 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:49:00 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:49:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:00 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:49:00 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:49:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-963fbcc1-ef9c-48bf-840a-d4e598bfd028 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:00 devstack sudo[102130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-963fbcc1-ef9c-48bf-840a-d4e598bfd028 1073741824
Jun 26 05:49:00 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:00 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-2ca20e35-6d32-49cd-b987-c18361b0fcef tempest-VolumesSnapshotListTestJSON-1134578390 None] Create snapshot completed successfully
Jun 26 05:49:01 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-963fbcc1-ef9c-48bf-840a-d4e598bfd028 1073741824" returned: 0 in 1.091s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-963fbcc1-ef9c-48bf-840a-d4e598bfd028 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:01 devstack sudo[102139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-963fbcc1-ef9c-48bf-840a-d4e598bfd028
Jun 26 05:49:01 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] Acquiring lock "cinder-aa067891-3a74-4f74-b55a-63ff67ab3f96-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-aa067891-3a74-4f74-b55a-63ff67ab3f96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] Acquiring lock "cinder-quobyte-08921111-cd52-4fbd-863f-c69d12fe30b9" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-quobyte-08921111-cd52-4fbd-863f-c69d12fe30b9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] Acquiring lock "cinder-quobyte-aa067891-3a74-4f74-b55a-63ff67ab3f96" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-quobyte-aa067891-3a74-4f74-b55a-63ff67ab3f96" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] Deleting offline snapshot aa067891-3a74-4f74-b55a-63ff67ab3f96 of volume 08921111-cd52-4fbd-863f-c69d12fe30b9 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:49:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] snapshot_file for this snap is: volume-08921111-cd52-4fbd-863f-c69d12fe30b9.aa067891-3a74-4f74-b55a-63ff67ab3f96 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:49:02 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8999f8-dd00-48b6-b638-100e7da4fe9b]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:49:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.aa067891-3a74-4f74-b55a-63ff67ab3f96 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:02 devstack sudo[102141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.aa067891-3a74-4f74-b55a-63ff67ab3f96
Jun 26 05:49:02 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:02 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-963fbcc1-ef9c-48bf-840a-d4e598bfd028" returned: 0 in 0.847s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:49:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.012s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96a2663-d1fe-40e8-97c3-787572656340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-963fbcc1-ef9c-48bf-840a-d4e598bfd028', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf543235-f8d7-4a28-af64-76d142347915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:02 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Volume volume-963fbcc1-ef9c-48bf-840a-d4e598bfd028 (963fbcc1-ef9c-48bf-840a-d4e598bfd028): created successfully
Jun 26 05:49:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf543235-f8d7-4a28-af64-76d142347915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Flow 'volume_create_manager' (fe689b9b-3fd7-4a26-992b-7a30c000f2ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:49:02 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-385607b1-0cec-4d1d-bdf2-96bc366a3b99 tempest-VolumesTestJSON-835837134 None] Created volume successfully.
Jun 26 05:49:03 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.aa067891-3a74-4f74-b55a-63ff67ab3f96" returned: 0 in 0.917s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:03 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08921111-cd52-4fbd-863f-c69d12fe30b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:49:03 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfafabe1-2b18-4d22-adc7-224f37ff314d]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:49:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:03 devstack sudo[102147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6
Jun 26 05:49:03 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:04 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6" returned: 0 in 0.932s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:04 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08921111-cd52-4fbd-863f-c69d12fe30b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:49:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.aa067891-3a74-4f74-b55a-63ff67ab3f96 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:04 devstack sudo[102154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.aa067891-3a74-4f74-b55a-63ff67ab3f96
Jun 26 05:49:04 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:04 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-92792692-7b60-4f48-a412-de43a1f2fb5d tempest-VolumesTestJSON-835837134 None] Acquiring lock "cinder-963fbcc1-ef9c-48bf-840a-d4e598bfd028-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:04 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-92792692-7b60-4f48-a412-de43a1f2fb5d tempest-VolumesTestJSON-835837134 None] Lock "cinder-963fbcc1-ef9c-48bf-840a-d4e598bfd028-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:04 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-92792692-7b60-4f48-a412-de43a1f2fb5d tempest-VolumesTestJSON-835837134 None] Acquiring lock "cinder-quobyte-963fbcc1-ef9c-48bf-840a-d4e598bfd028" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:04 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-92792692-7b60-4f48-a412-de43a1f2fb5d tempest-VolumesTestJSON-835837134 None] Lock "cinder-quobyte-963fbcc1-ef9c-48bf-840a-d4e598bfd028" acquired by "delete_volume" :: waited 0.017s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:04 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef6da09-868a-4eed-8fb7-310fd5087e1b]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:49:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-92792692-7b60-4f48-a412-de43a1f2fb5d tempest-VolumesTestJSON-835837134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-963fbcc1-ef9c-48bf-840a-d4e598bfd028 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:04 devstack sudo[102156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-963fbcc1-ef9c-48bf-840a-d4e598bfd028
Jun 26 05:49:04 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:05 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.aa067891-3a74-4f74-b55a-63ff67ab3f96" returned: 0 in 0.788s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.aa067891-3a74-4f74-b55a-63ff67ab3f96 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:05 devstack sudo[102161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.aa067891-3a74-4f74-b55a-63ff67ab3f96
Jun 26 05:49:05 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:05 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-92792692-7b60-4f48-a412-de43a1f2fb5d tempest-VolumesTestJSON-835837134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-963fbcc1-ef9c-48bf-840a-d4e598bfd028" returned: 0 in 0.802s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-92792692-7b60-4f48-a412-de43a1f2fb5d tempest-VolumesTestJSON-835837134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-963fbcc1-ef9c-48bf-840a-d4e598bfd028 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:05 devstack sudo[102167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-963fbcc1-ef9c-48bf-840a-d4e598bfd028
Jun 26 05:49:05 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:05 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.aa067891-3a74-4f74-b55a-63ff67ab3f96" returned: 0 in 0.713s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:05 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-quobyte-aa067891-3a74-4f74-b55a-63ff67ab3f96" released by "_delete_snapshot" :: held 3.507s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:05 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-quobyte-08921111-cd52-4fbd-863f-c69d12fe30b9" released by "delete_snapshot" :: held 3.544s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:05 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] Created reservations ['45885646-62d1-4ff0-b36b-87236035753f', 'b562655e-29a7-40b9-97e9-d883b1d2ba28', '49a1bae0-88b1-496f-bf26-32982c27204a', 'a16ad441-2705-45ea-961b-86de8b10e6bd'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:49:05 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] Delete snapshot completed successfully.
Jun 26 05:49:05 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-40d80ccd-7192-48d9-9da2-03f1186e764b tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-aa067891-3a74-4f74-b55a-63ff67ab3f96-delete_snapshot" released by "delete_snapshot" :: held 3.697s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:06 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-92792692-7b60-4f48-a412-de43a1f2fb5d tempest-VolumesTestJSON-835837134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-963fbcc1-ef9c-48bf-840a-d4e598bfd028" returned: 0 in 0.662s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-92792692-7b60-4f48-a412-de43a1f2fb5d tempest-VolumesTestJSON-835837134 None] Lock "cinder-quobyte-963fbcc1-ef9c-48bf-840a-d4e598bfd028" released by "delete_volume" :: held 1.506s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-92792692-7b60-4f48-a412-de43a1f2fb5d tempest-VolumesTestJSON-835837134 None] Created reservations ['ac93cafe-d9ee-4f35-a5fa-bae68bc8b324', 'b98c3010-588e-4bc9-9d58-416b7a86cc59', '6cb912a5-5127-4104-8cb8-04fec76f6a7b', 'b3962d10-11fc-45ea-80b9-beb893dabd1a'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-92792692-7b60-4f48-a412-de43a1f2fb5d tempest-VolumesTestJSON-835837134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-92792692-7b60-4f48-a412-de43a1f2fb5d tempest-VolumesTestJSON-835837134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-92792692-7b60-4f48-a412-de43a1f2fb5d tempest-VolumesTestJSON-835837134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-92792692-7b60-4f48-a412-de43a1f2fb5d tempest-VolumesTestJSON-835837134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-92792692-7b60-4f48-a412-de43a1f2fb5d tempest-VolumesTestJSON-835837134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-92792692-7b60-4f48-a412-de43a1f2fb5d tempest-VolumesTestJSON-835837134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:06 devstack sudo[102171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:49:06 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] Acquiring lock "cinder-345d05e2-a9e1-4494-b013-c43cd5e060a6-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-345d05e2-a9e1-4494-b013-c43cd5e060a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] Acquiring lock "cinder-quobyte-08921111-cd52-4fbd-863f-c69d12fe30b9" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-quobyte-08921111-cd52-4fbd-863f-c69d12fe30b9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] Acquiring lock "cinder-quobyte-345d05e2-a9e1-4494-b013-c43cd5e060a6" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-quobyte-345d05e2-a9e1-4494-b013-c43cd5e060a6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] Deleting offline snapshot 345d05e2-a9e1-4494-b013-c43cd5e060a6 of volume 08921111-cd52-4fbd-863f-c69d12fe30b9 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] snapshot_file for this snap is: volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[e220b27b-a68b-4362-a930-f8ee2983d9f2]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e5b4c65b-f91f-475b-a79d-73b9c15c057d tempest-VolumesTestJSON-835837134 None] Acquiring lock "cinder-1bae0e5d-6c68-4e31-b7de-c31eb204b594-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e5b4c65b-f91f-475b-a79d-73b9c15c057d tempest-VolumesTestJSON-835837134 None] Lock "cinder-1bae0e5d-6c68-4e31-b7de-c31eb204b594-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:06 devstack sudo[102173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6
Jun 26 05:49:06 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e5b4c65b-f91f-475b-a79d-73b9c15c057d tempest-VolumesTestJSON-835837134 None] Acquiring lock "cinder-quobyte-1bae0e5d-6c68-4e31-b7de-c31eb204b594" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e5b4c65b-f91f-475b-a79d-73b9c15c057d tempest-VolumesTestJSON-835837134 None] Lock "cinder-quobyte-1bae0e5d-6c68-4e31-b7de-c31eb204b594" acquired by "delete_volume" :: waited 0.033s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d4450d-3b8d-4008-b82e-3171e82b9a84]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e5b4c65b-f91f-475b-a79d-73b9c15c057d tempest-VolumesTestJSON-835837134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1bae0e5d-6c68-4e31-b7de-c31eb204b594 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:06 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-92792692-7b60-4f48-a412-de43a1f2fb5d tempest-VolumesTestJSON-835837134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.803s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:06 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-92792692-7b60-4f48-a412-de43a1f2fb5d tempest-VolumesTestJSON-835837134 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:49:06 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-92792692-7b60-4f48-a412-de43a1f2fb5d tempest-VolumesTestJSON-835837134 None] Deleted volume successfully.
Jun 26 05:49:07 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-92792692-7b60-4f48-a412-de43a1f2fb5d tempest-VolumesTestJSON-835837134 None] Lock "cinder-963fbcc1-ef9c-48bf-840a-d4e598bfd028-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:07 devstack sudo[102176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1bae0e5d-6c68-4e31-b7de-c31eb204b594
Jun 26 05:49:07 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:07 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6" returned: 0 in 1.023s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08921111-cd52-4fbd-863f-c69d12fe30b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:49:07 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc351e2-3c1f-45f5-a36b-3f20497c0c5c]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:49:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:07 devstack sudo[102190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8
Jun 26 05:49:07 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:07 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e5b4c65b-f91f-475b-a79d-73b9c15c057d tempest-VolumesTestJSON-835837134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1bae0e5d-6c68-4e31-b7de-c31eb204b594" returned: 0 in 0.948s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e5b4c65b-f91f-475b-a79d-73b9c15c057d tempest-VolumesTestJSON-835837134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1bae0e5d-6c68-4e31-b7de-c31eb204b594 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:07 devstack sudo[102194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1bae0e5d-6c68-4e31-b7de-c31eb204b594
Jun 26 05:49:07 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:08 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e5b4c65b-f91f-475b-a79d-73b9c15c057d tempest-VolumesTestJSON-835837134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1bae0e5d-6c68-4e31-b7de-c31eb204b594" returned: 0 in 0.823s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:08 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e5b4c65b-f91f-475b-a79d-73b9c15c057d tempest-VolumesTestJSON-835837134 None] Lock "cinder-quobyte-1bae0e5d-6c68-4e31-b7de-c31eb204b594" released by "delete_volume" :: held 1.833s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:08 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-e5b4c65b-f91f-475b-a79d-73b9c15c057d tempest-VolumesTestJSON-835837134 None] Created reservations ['11473e7a-fd97-4f2a-8fd7-860c52bab27a', '64dd1fac-49d9-4935-beda-b7443ef7ad32', '0067ac08-37c9-4f38-b8ac-c15839effd7f', '7f064740-5120-4a97-84fd-f153ddd4126a'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:49:08 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8" returned: 0 in 1.097s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:08 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08921111-cd52-4fbd-863f-c69d12fe30b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:49:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:08 devstack sudo[102210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6
Jun 26 05:49:08 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e5b4c65b-f91f-475b-a79d-73b9c15c057d tempest-VolumesTestJSON-835837134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e5b4c65b-f91f-475b-a79d-73b9c15c057d tempest-VolumesTestJSON-835837134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:08 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e5b4c65b-f91f-475b-a79d-73b9c15c057d tempest-VolumesTestJSON-835837134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:49:08 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e5b4c65b-f91f-475b-a79d-73b9c15c057d tempest-VolumesTestJSON-835837134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:49:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e5b4c65b-f91f-475b-a79d-73b9c15c057d tempest-VolumesTestJSON-835837134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e5b4c65b-f91f-475b-a79d-73b9c15c057d tempest-VolumesTestJSON-835837134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:08 devstack sudo[102212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:49:08 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:09 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a62860c4-b2f3-4e92-810b-0f922d680818 tempest-VolumesTestJSON-835837134 None] Acquiring lock "cinder-07bd1b1f-b503-4dcf-be7f-15b16a9b180f-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:09 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a62860c4-b2f3-4e92-810b-0f922d680818 tempest-VolumesTestJSON-835837134 None] Lock "cinder-07bd1b1f-b503-4dcf-be7f-15b16a9b180f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:09 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a62860c4-b2f3-4e92-810b-0f922d680818 tempest-VolumesTestJSON-835837134 None] Acquiring lock "cinder-quobyte-07bd1b1f-b503-4dcf-be7f-15b16a9b180f" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:09 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a62860c4-b2f3-4e92-810b-0f922d680818 tempest-VolumesTestJSON-835837134 None] Lock "cinder-quobyte-07bd1b1f-b503-4dcf-be7f-15b16a9b180f" acquired by "delete_volume" :: waited 0.034s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:09 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1224f49-5c78-4669-aeba-19f54b6c8764]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:49:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a62860c4-b2f3-4e92-810b-0f922d680818 tempest-VolumesTestJSON-835837134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-07bd1b1f-b503-4dcf-be7f-15b16a9b180f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:09 devstack sudo[102221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-07bd1b1f-b503-4dcf-be7f-15b16a9b180f
Jun 26 05:49:09 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:09 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e5b4c65b-f91f-475b-a79d-73b9c15c057d tempest-VolumesTestJSON-835837134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.949s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:09 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-e5b4c65b-f91f-475b-a79d-73b9c15c057d tempest-VolumesTestJSON-835837134 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:49:09 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e5b4c65b-f91f-475b-a79d-73b9c15c057d tempest-VolumesTestJSON-835837134 None] Deleted volume successfully.
Jun 26 05:49:09 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e5b4c65b-f91f-475b-a79d-73b9c15c057d tempest-VolumesTestJSON-835837134 None] Lock "cinder-1bae0e5d-6c68-4e31-b7de-c31eb204b594-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:09 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6" returned: 0 in 1.129s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:09 devstack sudo[102238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6
Jun 26 05:49:09 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:49:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:49:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:49:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:10 devstack sudo[102294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:49:10 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:10 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a62860c4-b2f3-4e92-810b-0f922d680818 tempest-VolumesTestJSON-835837134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-07bd1b1f-b503-4dcf-be7f-15b16a9b180f" returned: 0 in 1.647s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a62860c4-b2f3-4e92-810b-0f922d680818 tempest-VolumesTestJSON-835837134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-07bd1b1f-b503-4dcf-be7f-15b16a9b180f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:11 devstack sudo[102301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-07bd1b1f-b503-4dcf-be7f-15b16a9b180f
Jun 26 05:49:11 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:11 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.345d05e2-a9e1-4494-b013-c43cd5e060a6" returned: 0 in 1.469s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-quobyte-345d05e2-a9e1-4494-b013-c43cd5e060a6" released by "_delete_snapshot" :: held 4.912s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-quobyte-08921111-cd52-4fbd-863f-c69d12fe30b9" released by "delete_snapshot" :: held 4.960s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:11 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] Created reservations ['e7d13a0d-8b30-4150-b94f-844865ecce90', '152f147b-af3a-48c8-a54e-3dd78a270d11', '328b5d39-8522-42e8-a1f7-cb848fdbcfbb', '7e3e695b-f3e0-4cd2-9f40-6c77d6f186fe'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:49:11 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] Delete snapshot completed successfully.
Jun 26 05:49:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-09bb61e6-f1e4-4c48-b848-82f4697a544d tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-345d05e2-a9e1-4494-b013-c43cd5e060a6-delete_snapshot" released by "delete_snapshot" :: held 5.191s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] Acquiring lock "cinder-4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] Acquiring lock "cinder-quobyte-08921111-cd52-4fbd-863f-c69d12fe30b9" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-quobyte-08921111-cd52-4fbd-863f-c69d12fe30b9" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] Acquiring lock "cinder-quobyte-4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-quobyte-4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] Deleting offline snapshot 4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8 of volume 08921111-cd52-4fbd-863f-c69d12fe30b9 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:49:12 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] snapshot_file for this snap is: volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:49:12 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:12 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9c1104-8265-4cd9-aa1c-d0f7a607aa41]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:49:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.340s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:12 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:49:12 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:49:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 28 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:49:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>, <Thread(tpool_thread_0, started daemon 124035494721216)>, <Thread(tpool_thread_1, started daemon 124035486328512)>, <Thread(tpool_thread_2, started daemon 124035477919424)>, <Thread(tpool_thread_3, started daemon 124035469510336)>, <Thread(tpool_thread_4, started daemon 124035461101248)>, <Thread(tpool_thread_5, started daemon 124035452692160)>, <Thread(tpool_thread_6, started daemon 124035444283072)>, <Thread(tpool_thread_7, started daemon 124035435873984)>, <Thread(tpool_thread_8, started daemon 124035427464896)>, <Thread(tpool_thread_9, started daemon 124035419055808)>, <Thread(tpool_thread_10, started daemon 124035410646720)>, <Thread(tpool_thread_11, started daemon 124035402237632)>, <Thread(tpool_thread_12, started daemon 124035393828544)>, <Thread(tpool_thread_13, started daemon 124035385419456)>, <Thread(tpool_thread_14, started daemon 124035377010368)>, <Thread(tpool_thread_15, started daemon 124035368601280)>, <Thread(tpool_thread_16, started daemon 124035360192192)>, <Thread(tpool_thread_17, started daemon 124035351783104)>, <Thread(tpool_thread_18, started daemon 124035343374016)>, <Thread(tpool_thread_19, started daemon 124035334964928)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:49:12 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a62860c4-b2f3-4e92-810b-0f922d680818 tempest-VolumesTestJSON-835837134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-07bd1b1f-b503-4dcf-be7f-15b16a9b180f" returned: 0 in 1.141s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:12 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a62860c4-b2f3-4e92-810b-0f922d680818 tempest-VolumesTestJSON-835837134 None] Lock "cinder-quobyte-07bd1b1f-b503-4dcf-be7f-15b16a9b180f" released by "delete_volume" :: held 2.870s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:12 devstack sudo[102318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8
Jun 26 05:49:12 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:12 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-a62860c4-b2f3-4e92-810b-0f922d680818 tempest-VolumesTestJSON-835837134 None] Created reservations ['55275c80-3692-4885-8600-b77cf0f927a2', '1a377e9e-7865-4130-9874-f350b3bdce4d', 'bf775b02-b6c2-4793-b9a2-1caa5f09140d', 'ed241fc3-0ed8-418d-ac13-e241c08e4c79'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:49:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a62860c4-b2f3-4e92-810b-0f922d680818 tempest-VolumesTestJSON-835837134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a62860c4-b2f3-4e92-810b-0f922d680818 tempest-VolumesTestJSON-835837134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:12 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a62860c4-b2f3-4e92-810b-0f922d680818 tempest-VolumesTestJSON-835837134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:49:12 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a62860c4-b2f3-4e92-810b-0f922d680818 tempest-VolumesTestJSON-835837134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:49:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a62860c4-b2f3-4e92-810b-0f922d680818 tempest-VolumesTestJSON-835837134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a62860c4-b2f3-4e92-810b-0f922d680818 tempest-VolumesTestJSON-835837134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:12 devstack sudo[102320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:49:12 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:13 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8" returned: 0 in 1.284s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:13 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08921111-cd52-4fbd-863f-c69d12fe30b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:49:13 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f1499b-6769-44cd-baf1-26ca9c0a5cbf]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:49:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:13 devstack sudo[102326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9
Jun 26 05:49:13 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Flow 'volume_create_manager' (26377c4e-ebfc-46a9-a48c-23a538efb529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:49:14 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a907634-a63c-40d2-8806-2903603cc548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a62860c4-b2f3-4e92-810b-0f922d680818 tempest-VolumesTestJSON-835837134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.872s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-a62860c4-b2f3-4e92-810b-0f922d680818 tempest-VolumesTestJSON-835837134 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:49:14 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-a62860c4-b2f3-4e92-810b-0f922d680818 tempest-VolumesTestJSON-835837134 None] Deleted volume successfully.
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a907634-a63c-40d2-8806-2903603cc548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1827393684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50ac74b-fbad-413a-a58a-bf9831f282c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75803e160c50408885ce3fafd42d83bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:49:14Z,use_quota=True,user_id='9661aa580c854dc892e5a443ac32a5fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52cb942a-d940-4b59-85cd-37ac2b4eee8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52cb942a-d940-4b59-85cd-37ac2b4eee8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a227070-2bde-4d54-a141-e7b1d934443c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a227070-2bde-4d54-a141-e7b1d934443c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b50ac74b-fbad-413a-a58a-bf9831f282c4', 'volume_name': 'volume-b50ac74b-fbad-413a-a58a-bf9831f282c4', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23111a86-f10e-4084-bbf6-ec1403e2034d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23111a86-f10e-4084-bbf6-ec1403e2034d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a2b1aa-9a91-4a7b-94bf-dcb7472e93e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:14 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Volume b50ac74b-fbad-413a-a58a-bf9831f282c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b50ac74b-fbad-413a-a58a-bf9831f282c4', 'volume_size': 1}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1827393684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50ac74b-fbad-413a-a58a-bf9831f282c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75803e160c50408885ce3fafd42d83bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:49:14Z,use_quota=True,user_id='9661aa580c854dc892e5a443ac32a5fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Creating volume b50ac74b-fbad-413a-a58a-bf9831f282c4 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:49:14 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b50ac74b-fbad-413a-a58a-bf9831f282c4 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a62860c4-b2f3-4e92-810b-0f922d680818 tempest-VolumesTestJSON-835837134 None] Lock "cinder-07bd1b1f-b503-4dcf-be7f-15b16a9b180f-delete_volume" released by "delete_volume" :: held 5.230s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:14 devstack sudo[102329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b50ac74b-fbad-413a-a58a-bf9831f282c4 1073741824
Jun 26 05:49:14 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:14 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9" returned: 0 in 1.286s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:14 devstack sudo[102335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8
Jun 26 05:49:14 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:15 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b50ac74b-fbad-413a-a58a-bf9831f282c4 1073741824" returned: 0 in 1.168s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b50ac74b-fbad-413a-a58a-bf9831f282c4 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:15 devstack sudo[102346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b50ac74b-fbad-413a-a58a-bf9831f282c4
Jun 26 05:49:15 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:15 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8" returned: 0 in 1.039s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:15 devstack sudo[102348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8
Jun 26 05:49:15 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:16 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b50ac74b-fbad-413a-a58a-bf9831f282c4" returned: 0 in 0.814s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:49:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a2b1aa-9a91-4a7b-94bf-dcb7472e93e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b50ac74b-fbad-413a-a58a-bf9831f282c4', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6040e50-6317-486d-8474-a154a9c8323c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:16 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Volume volume-b50ac74b-fbad-413a-a58a-bf9831f282c4 (b50ac74b-fbad-413a-a58a-bf9831f282c4): created successfully
Jun 26 05:49:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6040e50-6317-486d-8474-a154a9c8323c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Flow 'volume_create_manager' (26377c4e-ebfc-46a9-a48c-23a538efb529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:49:16 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9.4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8" returned: 0 in 0.738s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:16 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-a5c5425d-6acc-45c5-b8ea-a990dde63dba tempest-VolumeQuotasNegativeTestJSON-13866458 None] Created volume successfully.
Jun 26 05:49:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-quobyte-4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8" released by "_delete_snapshot" :: held 4.522s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-quobyte-08921111-cd52-4fbd-863f-c69d12fe30b9" released by "delete_snapshot" :: held 4.557s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:16 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] Created reservations ['765f8c57-1581-4fee-903c-368897c1e741', '263999f9-84a4-4122-b1db-25f9fee36be0', '74257576-b888-44b6-bc83-ff689b354ad4', '4e5d30e8-93ac-4736-9a7a-43208011f96f'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:49:16 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] Delete snapshot completed successfully.
Jun 26 05:49:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d7c10640-95a5-4611-85e0-f2bfbc4623d0 tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-4d2959f9-e1b6-4e50-8ff1-a52c2ed86da8-delete_snapshot" released by "delete_snapshot" :: held 4.716s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c7e08d95-b00c-45e0-9345-2489b665e48a tempest-VolumesSnapshotListTestJSON-1134578390 None] Acquiring lock "cinder-08921111-cd52-4fbd-863f-c69d12fe30b9-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c7e08d95-b00c-45e0-9345-2489b665e48a tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-08921111-cd52-4fbd-863f-c69d12fe30b9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c7e08d95-b00c-45e0-9345-2489b665e48a tempest-VolumesSnapshotListTestJSON-1134578390 None] Acquiring lock "cinder-quobyte-08921111-cd52-4fbd-863f-c69d12fe30b9" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c7e08d95-b00c-45e0-9345-2489b665e48a tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-quobyte-08921111-cd52-4fbd-863f-c69d12fe30b9" acquired by "delete_volume" :: waited 0.021s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:17 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[f706002b-c465-4293-a5e3-a26883ad4af1]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:49:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c7e08d95-b00c-45e0-9345-2489b665e48a tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:18 devstack sudo[102352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9
Jun 26 05:49:18 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-75ec0eaa-2d95-409c-b225-8f5b29489a66 tempest-BackendsCapabilitiesAdminTestsJSON-1101247684 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93708) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jun 26 05:49:18 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8efbbbc4-ff89-4600-b86e-f868d4a7536f tempest-VolumeQuotasNegativeTestJSON-13866458 None] Acquiring lock "cinder-b50ac74b-fbad-413a-a58a-bf9831f282c4-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:18 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8efbbbc4-ff89-4600-b86e-f868d4a7536f tempest-VolumeQuotasNegativeTestJSON-13866458 None] Lock "cinder-b50ac74b-fbad-413a-a58a-bf9831f282c4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:18 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8efbbbc4-ff89-4600-b86e-f868d4a7536f tempest-VolumeQuotasNegativeTestJSON-13866458 None] Acquiring lock "cinder-quobyte-b50ac74b-fbad-413a-a58a-bf9831f282c4" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:18 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8efbbbc4-ff89-4600-b86e-f868d4a7536f tempest-VolumeQuotasNegativeTestJSON-13866458 None] Lock "cinder-quobyte-b50ac74b-fbad-413a-a58a-bf9831f282c4" acquired by "delete_volume" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:18 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5c6322-4875-489a-8d85-29a44ed69194]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:49:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8efbbbc4-ff89-4600-b86e-f868d4a7536f tempest-VolumeQuotasNegativeTestJSON-13866458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b50ac74b-fbad-413a-a58a-bf9831f282c4 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:18 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c7e08d95-b00c-45e0-9345-2489b665e48a tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9" returned: 0 in 0.870s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c7e08d95-b00c-45e0-9345-2489b665e48a tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:18 devstack sudo[102360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9
Jun 26 05:49:18 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:18 devstack sudo[102359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b50ac74b-fbad-413a-a58a-bf9831f282c4
Jun 26 05:49:18 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-57963608-e723-4dba-8795-a422003b398d tempest-BackendsCapabilitiesAdminTestsJSON-1101247684 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93708) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jun 26 05:49:19 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c7e08d95-b00c-45e0-9345-2489b665e48a tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-08921111-cd52-4fbd-863f-c69d12fe30b9" returned: 0 in 0.685s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c7e08d95-b00c-45e0-9345-2489b665e48a tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-quobyte-08921111-cd52-4fbd-863f-c69d12fe30b9" released by "delete_volume" :: held 1.641s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:19 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8efbbbc4-ff89-4600-b86e-f868d4a7536f tempest-VolumeQuotasNegativeTestJSON-13866458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b50ac74b-fbad-413a-a58a-bf9831f282c4" returned: 0 in 0.828s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8efbbbc4-ff89-4600-b86e-f868d4a7536f tempest-VolumeQuotasNegativeTestJSON-13866458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b50ac74b-fbad-413a-a58a-bf9831f282c4 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:19 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-c7e08d95-b00c-45e0-9345-2489b665e48a tempest-VolumesSnapshotListTestJSON-1134578390 None] Created reservations ['e126ebdf-b2fc-493e-a3b3-e9f306df95cf', '5951f26f-96c9-423a-8af0-d61547842f40', 'ad982522-0d3c-4a5b-9362-1755f5311a63', 'fa6facf1-91cc-421f-b63c-2ed3bee90f6f'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:49:19 devstack sudo[102367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b50ac74b-fbad-413a-a58a-bf9831f282c4
Jun 26 05:49:19 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c7e08d95-b00c-45e0-9345-2489b665e48a tempest-VolumesSnapshotListTestJSON-1134578390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c7e08d95-b00c-45e0-9345-2489b665e48a tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:19 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c7e08d95-b00c-45e0-9345-2489b665e48a tempest-VolumesSnapshotListTestJSON-1134578390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:49:19 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c7e08d95-b00c-45e0-9345-2489b665e48a tempest-VolumesSnapshotListTestJSON-1134578390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:49:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c7e08d95-b00c-45e0-9345-2489b665e48a tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c7e08d95-b00c-45e0-9345-2489b665e48a tempest-VolumesSnapshotListTestJSON-1134578390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:19 devstack sudo[102369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:49:19 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:20 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8efbbbc4-ff89-4600-b86e-f868d4a7536f tempest-VolumeQuotasNegativeTestJSON-13866458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b50ac74b-fbad-413a-a58a-bf9831f282c4" returned: 0 in 0.764s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:20 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8efbbbc4-ff89-4600-b86e-f868d4a7536f tempest-VolumeQuotasNegativeTestJSON-13866458 None] Lock "cinder-quobyte-b50ac74b-fbad-413a-a58a-bf9831f282c4" released by "delete_volume" :: held 1.651s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:20 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-8efbbbc4-ff89-4600-b86e-f868d4a7536f tempest-VolumeQuotasNegativeTestJSON-13866458 None] Created reservations ['53c5da85-aa1c-406c-a6ae-93d8dd8afbc2', '1800e8bf-f49f-40dc-871a-3e515ed830d7', 'a7e4c3b1-bc5e-49a9-8569-81b40065cf97', '4e69d39a-b291-422a-a5ea-374caf11bb11'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:49:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8efbbbc4-ff89-4600-b86e-f868d4a7536f tempest-VolumeQuotasNegativeTestJSON-13866458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8efbbbc4-ff89-4600-b86e-f868d4a7536f tempest-VolumeQuotasNegativeTestJSON-13866458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:20 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8efbbbc4-ff89-4600-b86e-f868d4a7536f tempest-VolumeQuotasNegativeTestJSON-13866458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:49:20 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8efbbbc4-ff89-4600-b86e-f868d4a7536f tempest-VolumeQuotasNegativeTestJSON-13866458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:49:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8efbbbc4-ff89-4600-b86e-f868d4a7536f tempest-VolumeQuotasNegativeTestJSON-13866458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8efbbbc4-ff89-4600-b86e-f868d4a7536f tempest-VolumeQuotasNegativeTestJSON-13866458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:20 devstack sudo[102373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:49:20 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:20 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c7e08d95-b00c-45e0-9345-2489b665e48a tempest-VolumesSnapshotListTestJSON-1134578390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.944s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:20 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-c7e08d95-b00c-45e0-9345-2489b665e48a tempest-VolumesSnapshotListTestJSON-1134578390 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:49:20 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-c7e08d95-b00c-45e0-9345-2489b665e48a tempest-VolumesSnapshotListTestJSON-1134578390 None] Deleted volume successfully.
Jun 26 05:49:20 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c7e08d95-b00c-45e0-9345-2489b665e48a tempest-VolumesSnapshotListTestJSON-1134578390 None] Lock "cinder-08921111-cd52-4fbd-863f-c69d12fe30b9-delete_volume" released by "delete_volume" :: held 2.918s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:21 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8efbbbc4-ff89-4600-b86e-f868d4a7536f tempest-VolumeQuotasNegativeTestJSON-13866458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.152s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:21 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-8efbbbc4-ff89-4600-b86e-f868d4a7536f tempest-VolumeQuotasNegativeTestJSON-13866458 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:49:21 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-8efbbbc4-ff89-4600-b86e-f868d4a7536f tempest-VolumeQuotasNegativeTestJSON-13866458 None] Deleted volume successfully.
Jun 26 05:49:21 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8efbbbc4-ff89-4600-b86e-f868d4a7536f tempest-VolumeQuotasNegativeTestJSON-13866458 None] Lock "cinder-b50ac74b-fbad-413a-a58a-bf9831f282c4-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Flow 'volume_create_manager' (bd13945d-e96d-4b01-9219-06f801336039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ef9d0c-95b7-42ae-91f6-91e8982c5ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ef9d0c-95b7-42ae-91f6-91e8982c5ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-467893182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb77bd7b-c18b-4fb1-821c-4c7362b1c05d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de9c348f5dd441538a2e1b3a3b0018e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:49:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:49:25Z,use_quota=True,user_id='83301cf5f8ed4faea2ad8be57001c396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110c9606-545d-4555-919f-7bc6635d7ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110c9606-545d-4555-919f-7bc6635d7ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b56de5d-e8a9-4e18-9b06-f9bc3cdc8de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b56de5d-e8a9-4e18-9b06-f9bc3cdc8de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb77bd7b-c18b-4fb1-821c-4c7362b1c05d', 'volume_name': 'volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d', 'volume_size': 2}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84181f2f-5a97-4301-a84d-fcc19dec3d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84181f2f-5a97-4301-a84d-fcc19dec3d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3939e93-b710-44d0-befb-3e49ac37c141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:25 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Volume bb77bd7b-c18b-4fb1-821c-4c7362b1c05d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d', 'volume_size': 2}
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-467893182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb77bd7b-c18b-4fb1-821c-4c7362b1c05d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de9c348f5dd441538a2e1b3a3b0018e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:49:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:49:25Z,use_quota=True,user_id='83301cf5f8ed4faea2ad8be57001c396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Creating volume bb77bd7b-c18b-4fb1-821c-4c7362b1c05d {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:49:25 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:49:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d 2147483648 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:25 devstack sudo[102414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d 2147483648
Jun 26 05:49:25 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:26 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d 2147483648" returned: 0 in 1.041s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:26 devstack sudo[102420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d
Jun 26 05:49:26 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:27 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d" returned: 0 in 0.690s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:49:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3939e93-b710-44d0-befb-3e49ac37c141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d', 'volume_size': 2}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2745e288-b440-432c-b5ae-ff14f02db6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:27 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Volume volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d (bb77bd7b-c18b-4fb1-821c-4c7362b1c05d): created successfully
Jun 26 05:49:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2745e288-b440-432c-b5ae-ff14f02db6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Flow 'volume_create_manager' (bd13945d-e96d-4b01-9219-06f801336039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:49:27 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-999c538b-8f0b-4d01-803d-13a868c661e1 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Created volume successfully.
Jun 26 05:49:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-45af85ee-4523-4120-8558-74a123a62805 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-45af85ee-4523-4120-8558-74a123a62805 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-45af85ee-4523-4120-8558-74a123a62805 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Creating offline snapshot 06cc16db-6aac-437b-89e5-eb232a02226f of volume bb77bd7b-c18b-4fb1-821c-4c7362b1c05d {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:49:27 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecd560b-8791-4431-859f-c471dde4a113]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:49:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-45af85ee-4523-4120-8558-74a123a62805 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:27 devstack sudo[102423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d
Jun 26 05:49:27 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:28 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:49:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Flow 'volume_create_manager' (61848b0e-845b-4cfb-b653-5c173473c904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:49:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5b6923-98fe-4a01-8ac0-7f24eb9c81b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5b6923-98fe-4a01-8ac0-7f24eb9c81b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-47679073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a6d464-db50-4094-b995-1efa546e8085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03aa87c9e7c34a1e90afd1da2ceb6293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:49:28Z,use_quota=True,user_id='17e103b886cd42c48209e7971dd8d874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f08ed2a2-9dde-4870-8b22-82ac87b67dac),volume_type_id=f08ed2a2-9dde-4870-8b22-82ac87b67dac)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9cc6764-f752-4e4f-8fa9-e1af1c2fbe40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9cc6764-f752-4e4f-8fa9-e1af1c2fbe40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5831c7f2-6569-4db0-af06-803ef22d84cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5831c7f2-6569-4db0-af06-803ef22d84cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64a6d464-db50-4094-b995-1efa546e8085', 'volume_name': 'volume-64a6d464-db50-4094-b995-1efa546e8085', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124dbcab-a10f-4f8b-bace-e9895d58f96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124dbcab-a10f-4f8b-bace-e9895d58f96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74d3b80-e009-4615-9646-6033a97902ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:28 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Volume 64a6d464-db50-4094-b995-1efa546e8085: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64a6d464-db50-4094-b995-1efa546e8085', 'volume_size': 1}
Jun 26 05:49:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:28 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-45af85ee-4523-4120-8558-74a123a62805 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d" returned: 0 in 0.916s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-45af85ee-4523-4120-8558-74a123a62805 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.06cc16db-6aac-437b-89e5-eb232a02226f 2G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:28 devstack sudo[102428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.06cc16db-6aac-437b-89e5-eb232a02226f 2G
Jun 26 05:49:28 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:29 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-45af85ee-4523-4120-8558-74a123a62805 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.06cc16db-6aac-437b-89e5-eb232a02226f 2G" returned: 0 in 0.803s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-45af85ee-4523-4120-8558-74a123a62805 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.06cc16db-6aac-437b-89e5-eb232a02226f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:29 devstack sudo[102434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.06cc16db-6aac-437b-89e5-eb232a02226f
Jun 26 05:49:29 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:30 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-45af85ee-4523-4120-8558-74a123a62805 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.06cc16db-6aac-437b-89e5-eb232a02226f" returned: 0 in 0.689s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:30 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-45af85ee-4523-4120-8558-74a123a62805 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.06cc16db-6aac-437b-89e5-eb232a02226f is being set with open permissions: ugo+rw
Jun 26 05:49:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-45af85ee-4523-4120-8558-74a123a62805 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.06cc16db-6aac-437b-89e5-eb232a02226f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:30 devstack sudo[102439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.06cc16db-6aac-437b-89e5-eb232a02226f
Jun 26 05:49:30 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:30 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-45af85ee-4523-4120-8558-74a123a62805 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.06cc16db-6aac-437b-89e5-eb232a02226f" returned: 0 in 0.670s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:30 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=99,cinder:UPDATE=132,cinder:INSERT=33,cinder:DELETE=10 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:49:30 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=120,cinder:SELECT=101,cinder:INSERT=26,cinder:DELETE=7 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:49:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-45af85ee-4523-4120-8558-74a123a62805 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:30 devstack sudo[102442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.info
Jun 26 05:49:30 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:31 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-45af85ee-4523-4120-8558-74a123a62805 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.info" returned: 0 in 0.736s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:31 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-45af85ee-4523-4120-8558-74a123a62805 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.info is being set with open permissions: ugo+rw
Jun 26 05:49:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-45af85ee-4523-4120-8558-74a123a62805 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:31 devstack sudo[102446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.info
Jun 26 05:49:31 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:32 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-45af85ee-4523-4120-8558-74a123a62805 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.info" returned: 0 in 0.677s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-45af85ee-4523-4120-8558-74a123a62805 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.610s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.755s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:32 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-47679073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a6d464-db50-4094-b995-1efa546e8085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03aa87c9e7c34a1e90afd1da2ceb6293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:49:28Z,use_quota=True,user_id='17e103b886cd42c48209e7971dd8d874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f08ed2a2-9dde-4870-8b22-82ac87b67dac),volume_type_id=f08ed2a2-9dde-4870-8b22-82ac87b67dac)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:49:32 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Creating volume 64a6d464-db50-4094-b995-1efa546e8085 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:49:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:32 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:49:32 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:49:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:32 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:49:32 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:49:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-64a6d464-db50-4094-b995-1efa546e8085 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:32 devstack sudo[102449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-64a6d464-db50-4094-b995-1efa546e8085 1073741824
Jun 26 05:49:32 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:32 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-45af85ee-4523-4120-8558-74a123a62805 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Create snapshot completed successfully
Jun 26 05:49:33 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Acquiring lock "cinder-06cc16db-6aac-437b-89e5-eb232a02226f-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:33 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Lock "cinder-06cc16db-6aac-437b-89e5-eb232a02226f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:33 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Acquiring lock "cinder-quobyte-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:33 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Lock "cinder-quobyte-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:33 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Acquiring lock "cinder-quobyte-06cc16db-6aac-437b-89e5-eb232a02226f" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:33 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Lock "cinder-quobyte-06cc16db-6aac-437b-89e5-eb232a02226f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Deleting offline snapshot 06cc16db-6aac-437b-89e5-eb232a02226f of volume bb77bd7b-c18b-4fb1-821c-4c7362b1c05d {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:49:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] snapshot_file for this snap is: volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.06cc16db-6aac-437b-89e5-eb232a02226f {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:49:33 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[555518bd-9922-4db5-8720-ce59b23e00d7]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:49:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.06cc16db-6aac-437b-89e5-eb232a02226f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:33 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:33 devstack sudo[102455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.06cc16db-6aac-437b-89e5-eb232a02226f
Jun 26 05:49:33 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-64a6d464-db50-4094-b995-1efa546e8085 1073741824" returned: 0 in 0.913s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-64a6d464-db50-4094-b995-1efa546e8085 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:33 devstack sudo[102457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-64a6d464-db50-4094-b995-1efa546e8085
Jun 26 05:49:33 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:34 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-64a6d464-db50-4094-b995-1efa546e8085" returned: 0 in 0.697s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:34 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:49:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:34 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74d3b80-e009-4615-9646-6033a97902ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64a6d464-db50-4094-b995-1efa546e8085', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:34 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c7f45e-69ff-43ec-8341-cd1a3be31a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:34 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Volume volume-64a6d464-db50-4094-b995-1efa546e8085 (64a6d464-db50-4094-b995-1efa546e8085): created successfully
Jun 26 05:49:34 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c7f45e-69ff-43ec-8341-cd1a3be31a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:34 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Flow 'volume_create_manager' (61848b0e-845b-4cfb-b653-5c173473c904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:49:34 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:34 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-c935d8a4-36b6-4df2-bd1c-252b7110dbe5 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Created volume successfully.
Jun 26 05:49:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.06cc16db-6aac-437b-89e5-eb232a02226f" returned: 0 in 0.953s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:34 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:49:34 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[7641bad3-b316-4d82-ae54-6aa608b01890]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:49:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:34 devstack sudo[102467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d
Jun 26 05:49:34 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:34 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d" returned: 0 in 0.801s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.06cc16db-6aac-437b-89e5-eb232a02226f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:35 devstack sudo[102472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.06cc16db-6aac-437b-89e5-eb232a02226f
Jun 26 05:49:35 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ad939b82-278b-48a3-915b-d66b064d2c09 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ad939b82-278b-48a3-915b-d66b064d2c09 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:35 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ad939b82-278b-48a3-915b-d66b064d2c09 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:49:35 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ad939b82-278b-48a3-915b-d66b064d2c09 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:49:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ad939b82-278b-48a3-915b-d66b064d2c09 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ad939b82-278b-48a3-915b-d66b064d2c09 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:35 devstack sudo[102517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:49:35 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:36 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.06cc16db-6aac-437b-89e5-eb232a02226f" returned: 0 in 1.281s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.06cc16db-6aac-437b-89e5-eb232a02226f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:36 devstack sudo[102524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.06cc16db-6aac-437b-89e5-eb232a02226f
Jun 26 05:49:36 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:36 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ad939b82-278b-48a3-915b-d66b064d2c09 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.803s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:36 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-ad939b82-278b-48a3-915b-d66b064d2c09 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:49:36 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-ad939b82-278b-48a3-915b-d66b064d2c09 tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Retype volume completed successfully.
Jun 26 05:49:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Acquiring lock "cinder-64a6d464-db50-4094-b995-1efa546e8085-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Lock "cinder-64a6d464-db50-4094-b995-1efa546e8085-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Acquiring lock "cinder-quobyte-64a6d464-db50-4094-b995-1efa546e8085" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Lock "cinder-quobyte-64a6d464-db50-4094-b995-1efa546e8085" acquired by "delete_volume" :: waited 0.026s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:36 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b9d364-57d4-4ff4-a7a2-9427ff6d640b]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:49:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-64a6d464-db50-4094-b995-1efa546e8085 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:37 devstack sudo[102528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-64a6d464-db50-4094-b995-1efa546e8085
Jun 26 05:49:37 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:37 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d.06cc16db-6aac-437b-89e5-eb232a02226f" returned: 0 in 0.811s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Lock "cinder-quobyte-06cc16db-6aac-437b-89e5-eb232a02226f" released by "_delete_snapshot" :: held 3.999s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Lock "cinder-quobyte-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d" released by "delete_snapshot" :: held 4.035s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:37 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Created reservations ['15b5cef3-2c97-4aa6-8b27-9cb7962f2e67', '27b51698-5400-4b06-b932-ec82a460c0ac', 'd0a0c701-e424-42fa-8f50-f6962ee5caa3', 'ba113f1d-64a2-4958-bc2f-f36fc1b7c86d'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:49:37 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Delete snapshot completed successfully.
Jun 26 05:49:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-cc35e3e3-2c81-42a8-a0f1-66d51a1ea9ed tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Lock "cinder-06cc16db-6aac-437b-89e5-eb232a02226f-delete_snapshot" released by "delete_snapshot" :: held 4.279s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-951b5f11-ece2-4a89-b526-591ed0a33646 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Acquiring lock "cinder-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-951b5f11-ece2-4a89-b526-591ed0a33646 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Lock "cinder-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-951b5f11-ece2-4a89-b526-591ed0a33646 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Acquiring lock "cinder-quobyte-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-951b5f11-ece2-4a89-b526-591ed0a33646 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Lock "cinder-quobyte-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d" acquired by "delete_volume" :: waited 0.027s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:37 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79003ce-450b-4cf5-a8aa-7b83c72f6277]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:49:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-951b5f11-ece2-4a89-b526-591ed0a33646 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:37 devstack sudo[102531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d
Jun 26 05:49:37 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:38 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-64a6d464-db50-4094-b995-1efa546e8085" returned: 0 in 1.134s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-64a6d464-db50-4094-b995-1efa546e8085 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:38 devstack sudo[102537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-64a6d464-db50-4094-b995-1efa546e8085
Jun 26 05:49:38 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:38 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-951b5f11-ece2-4a89-b526-591ed0a33646 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d" returned: 0 in 1.050s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-951b5f11-ece2-4a89-b526-591ed0a33646 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:38 devstack sudo[102543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d
Jun 26 05:49:38 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:38 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-64a6d464-db50-4094-b995-1efa546e8085" returned: 0 in 0.899s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Lock "cinder-quobyte-64a6d464-db50-4094-b995-1efa546e8085" released by "delete_volume" :: held 2.104s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:39 devstack cinder-volume[93708]: WARNING cinder.quota [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:49:39 devstack cinder-volume[93708]: WARNING cinder.quota [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:49:39 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Created reservations ['3e5bebb2-825f-45f8-9e8b-29109fe7be5a', 'a4103e12-efd7-479e-96c2-def47a7937f1', 'aa5395df-9b8c-49d2-a887-c50bce6bb478', 'd4d12552-2b49-4c92-8668-8abba00a58ab'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:49:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:49:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:49:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:39 devstack sudo[102545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:49:39 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:39 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-951b5f11-ece2-4a89-b526-591ed0a33646 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d" returned: 0 in 0.824s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-951b5f11-ece2-4a89-b526-591ed0a33646 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Lock "cinder-quobyte-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d" released by "delete_volume" :: held 1.960s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:39 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-951b5f11-ece2-4a89-b526-591ed0a33646 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Created reservations ['ed1ea753-e85b-453d-bfd9-2eae6abad259', '07a99a59-4be2-43c4-a31d-30f41c601b61', '85d15977-9447-4489-8d82-7190f85ac981', '9aa97ccc-0762-4976-a4ca-0a591c611fa0'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:49:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-951b5f11-ece2-4a89-b526-591ed0a33646 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-951b5f11-ece2-4a89-b526-591ed0a33646 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-951b5f11-ece2-4a89-b526-591ed0a33646 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:49:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-951b5f11-ece2-4a89-b526-591ed0a33646 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:49:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-951b5f11-ece2-4a89-b526-591ed0a33646 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-951b5f11-ece2-4a89-b526-591ed0a33646 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:39 devstack sudo[102548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:49:39 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:40 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.822s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:40 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:49:40 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Deleted volume successfully.
Jun 26 05:49:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-590d835f-d9e8-43b5-87cf-b0d8c073558f tempest-VolumeRetypeWithoutMigrationTest-184617229 None] Lock "cinder-64a6d464-db50-4094-b995-1efa546e8085-delete_volume" released by "delete_volume" :: held 3.246s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:40 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-951b5f11-ece2-4a89-b526-591ed0a33646 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.843s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:40 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-951b5f11-ece2-4a89-b526-591ed0a33646 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:49:40 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-951b5f11-ece2-4a89-b526-591ed0a33646 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Deleted volume successfully.
Jun 26 05:49:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-951b5f11-ece2-4a89-b526-591ed0a33646 tempest-VolumesSnapshotNegativeTestJSON-111794201 None] Lock "cinder-bb77bd7b-c18b-4fb1-821c-4c7362b1c05d-delete_volume" released by "delete_volume" :: held 3.062s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Flow 'volume_create_manager' (22ef05c7-7eb4-4c89-ad36-8f45d05c843a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa02728c-9fb4-4c69-886c-0a04cedda0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa02728c-9fb4-4c69-886c-0a04cedda0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1022728961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d350d91-5ae4-4aba-a0dc-a27d804ac5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ef191ec77c423088c8b013be7fba3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:49:47Z,use_quota=True,user_id='55172f51791048a0bc96cb1c22ed2425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bfa98c-62f0-41c4-afe3-9aea2eec3287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bfa98c-62f0-41c4-afe3-9aea2eec3287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e45f22-c107-46f8-a7f9-8bc2b45440d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e45f22-c107-46f8-a7f9-8bc2b45440d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d350d91-5ae4-4aba-a0dc-a27d804ac5f6', 'volume_name': 'volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ecdf57-be23-42fa-ab75-0b1e9c4a7800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ecdf57-be23-42fa-ab75-0b1e9c4a7800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330c4361-3d4d-408a-a643-3ef093d63aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:47 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Volume 8d350d91-5ae4-4aba-a0dc-a27d804ac5f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6', 'volume_size': 1}
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1022728961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d350d91-5ae4-4aba-a0dc-a27d804ac5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ef191ec77c423088c8b013be7fba3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:49:47Z,use_quota=True,user_id='55172f51791048a0bc96cb1c22ed2425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Creating volume 8d350d91-5ae4-4aba-a0dc-a27d804ac5f6 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:49:47 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:49:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:47 devstack sudo[102553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6 1073741824
Jun 26 05:49:47 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:48 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6 1073741824" returned: 0 in 1.134s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:48 devstack sudo[102562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6
Jun 26 05:49:48 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:49 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6" returned: 0 in 0.889s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:49 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] <== create_volume: return (2084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:49:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:49 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330c4361-3d4d-408a-a643-3ef093d63aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:49 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e4c2a2-bc4e-45f5-bd6e-4e1e31f20ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:49 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Volume volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6 (8d350d91-5ae4-4aba-a0dc-a27d804ac5f6): created successfully
Jun 26 05:49:49 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e4c2a2-bc4e-45f5-bd6e-4e1e31f20ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:49 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Flow 'volume_create_manager' (22ef05c7-7eb4-4c89-ad36-8f45d05c843a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:49:49 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-347de435-897b-477e-9709-e3f7cf3c6049 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Created volume successfully.
Jun 26 05:49:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7e7deaec-e126-466a-b950-b5457e5542d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7e7deaec-e126-466a-b950-b5457e5542d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:50 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-7e7deaec-e126-466a-b950-b5457e5542d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Creating offline snapshot 8da2a78f-ef2c-47ff-951f-a79e438eb09f of volume 8d350d91-5ae4-4aba-a0dc-a27d804ac5f6 {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:49:50 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[690edb49-0d70-4c2b-af94-58233247a158]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:49:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7e7deaec-e126-466a-b950-b5457e5542d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:51 devstack sudo[102566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6
Jun 26 05:49:51 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:52 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:49:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Flow 'volume_create_manager' (ba80ea45-3266-4c5f-ae14-fb7e7ec3ee86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:49:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13ae237-34ff-44a8-b1c9-dd72b0ec9520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:52 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7e7deaec-e126-466a-b950-b5457e5542d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6" returned: 0 in 1.132s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7e7deaec-e126-466a-b950-b5457e5542d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.8da2a78f-ef2c-47ff-951f-a79e438eb09f 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13ae237-34ff-44a8-b1c9-dd72b0ec9520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-375887420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc4053c-5888-4214-91bc-170176f5569f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9feae47eeec24087809feb2c59ec1310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:49:52Z,use_quota=True,user_id='802e838e45954ba5bf158a4bd33888cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb80f9d1-00af-40e0-b215-d335d9857967),volume_type_id=fb80f9d1-00af-40e0-b215-d335d9857967)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892fca04-8194-40be-8195-071c280b5479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892fca04-8194-40be-8195-071c280b5479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:52 devstack sudo[102573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.8da2a78f-ef2c-47ff-951f-a79e438eb09f 1G
Jun 26 05:49:52 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71b386d-964c-402b-a336-f5303dd1d999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71b386d-964c-402b-a336-f5303dd1d999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecc4053c-5888-4214-91bc-170176f5569f', 'volume_name': 'volume-ecc4053c-5888-4214-91bc-170176f5569f', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c51caf5-3514-4d02-87ce-64b759df31ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c51caf5-3514-4d02-87ce-64b759df31ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d10816-bacd-4491-9ac9-4a0221434054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:52 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Volume ecc4053c-5888-4214-91bc-170176f5569f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecc4053c-5888-4214-91bc-170176f5569f', 'volume_size': 1}
Jun 26 05:49:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:53 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7e7deaec-e126-466a-b950-b5457e5542d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.8da2a78f-ef2c-47ff-951f-a79e438eb09f 1G" returned: 0 in 1.007s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7e7deaec-e126-466a-b950-b5457e5542d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.8da2a78f-ef2c-47ff-951f-a79e438eb09f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:53 devstack sudo[102579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.8da2a78f-ef2c-47ff-951f-a79e438eb09f
Jun 26 05:49:53 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:53 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7e7deaec-e126-466a-b950-b5457e5542d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.8da2a78f-ef2c-47ff-951f-a79e438eb09f" returned: 0 in 0.841s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:53 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-7e7deaec-e126-466a-b950-b5457e5542d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.8da2a78f-ef2c-47ff-951f-a79e438eb09f is being set with open permissions: ugo+rw
Jun 26 05:49:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7e7deaec-e126-466a-b950-b5457e5542d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.8da2a78f-ef2c-47ff-951f-a79e438eb09f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:54 devstack sudo[102584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.8da2a78f-ef2c-47ff-951f-a79e438eb09f
Jun 26 05:49:54 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:54 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7e7deaec-e126-466a-b950-b5457e5542d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.8da2a78f-ef2c-47ff-951f-a79e438eb09f" returned: 0 in 0.841s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7e7deaec-e126-466a-b950-b5457e5542d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:54 devstack sudo[102587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.info
Jun 26 05:49:54 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:55 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7e7deaec-e126-466a-b950-b5457e5542d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.info" returned: 0 in 0.820s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:55 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-7e7deaec-e126-466a-b950-b5457e5542d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.info is being set with open permissions: ugo+rw
Jun 26 05:49:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7e7deaec-e126-466a-b950-b5457e5542d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:55 devstack sudo[102596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.info
Jun 26 05:49:55 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:56 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7e7deaec-e126-466a-b950-b5457e5542d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.info" returned: 0 in 0.827s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7e7deaec-e126-466a-b950-b5457e5542d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.608s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.367s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-375887420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc4053c-5888-4214-91bc-170176f5569f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9feae47eeec24087809feb2c59ec1310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:49:52Z,use_quota=True,user_id='802e838e45954ba5bf158a4bd33888cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb80f9d1-00af-40e0-b215-d335d9857967),volume_type_id=fb80f9d1-00af-40e0-b215-d335d9857967)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:49:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Creating volume ecc4053c-5888-4214-91bc-170176f5569f {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:49:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:49:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:49:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:49:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:49:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:49:56 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:49:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ecc4053c-5888-4214-91bc-170176f5569f 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:56 devstack sudo[102612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ecc4053c-5888-4214-91bc-170176f5569f 1073741824
Jun 26 05:49:56 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:56 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-7e7deaec-e126-466a-b950-b5457e5542d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Create snapshot completed successfully
Jun 26 05:49:57 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ecc4053c-5888-4214-91bc-170176f5569f 1073741824" returned: 0 in 1.086s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ecc4053c-5888-4214-91bc-170176f5569f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:57 devstack sudo[102617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ecc4053c-5888-4214-91bc-170176f5569f
Jun 26 05:49:57 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Acquiring lock "cinder-8da2a78f-ef2c-47ff-951f-a79e438eb09f-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Lock "cinder-8da2a78f-ef2c-47ff-951f-a79e438eb09f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Acquiring lock "cinder-quobyte-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Lock "cinder-quobyte-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Acquiring lock "cinder-quobyte-8da2a78f-ef2c-47ff-951f-a79e438eb09f" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Lock "cinder-quobyte-8da2a78f-ef2c-47ff-951f-a79e438eb09f" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Deleting offline snapshot 8da2a78f-ef2c-47ff-951f-a79e438eb09f of volume 8d350d91-5ae4-4aba-a0dc-a27d804ac5f6 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:49:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] snapshot_file for this snap is: volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.8da2a78f-ef2c-47ff-951f-a79e438eb09f {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:49:57 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2936178-19ea-4698-bfb0-03bdb2a266b2]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:49:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.8da2a78f-ef2c-47ff-951f-a79e438eb09f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:58 devstack sudo[102619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.8da2a78f-ef2c-47ff-951f-a79e438eb09f
Jun 26 05:49:58 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:58 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ecc4053c-5888-4214-91bc-170176f5569f" returned: 0 in 0.739s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:49:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:49:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d10816-bacd-4491-9ac9-4a0221434054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecc4053c-5888-4214-91bc-170176f5569f', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8042c7-a5f7-4545-9201-69513f414860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:49:58 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Volume volume-ecc4053c-5888-4214-91bc-170176f5569f (ecc4053c-5888-4214-91bc-170176f5569f): created successfully
Jun 26 05:49:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8042c7-a5f7-4545-9201-69513f414860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:49:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Flow 'volume_create_manager' (ba80ea45-3266-4c5f-ae14-fb7e7ec3ee86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:49:58 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-3b0f5371-fb16-40be-af9d-eb4c27388759 tempest-VolumeTypesAccessTest-1137755574 None] Created volume successfully.
Jun 26 05:49:58 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.8da2a78f-ef2c-47ff-951f-a79e438eb09f" returned: 0 in 0.884s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:49:58 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffc7926-6b6f-476f-bb5e-1bdbbd64bc11]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:49:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:58 devstack sudo[102625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6
Jun 26 05:49:58 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:59 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] Acquiring lock "cinder-ecc4053c-5888-4214-91bc-170176f5569f-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:59 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] Lock "cinder-ecc4053c-5888-4214-91bc-170176f5569f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:59 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] Acquiring lock "cinder-quobyte-ecc4053c-5888-4214-91bc-170176f5569f" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:49:59 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] Lock "cinder-quobyte-ecc4053c-5888-4214-91bc-170176f5569f" acquired by "delete_volume" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:49:59 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda94327-3269-433a-b9d5-7e2e9a050359]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:49:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ecc4053c-5888-4214-91bc-170176f5569f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:59 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root
Jun 26 05:49:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6" returned: 0 in 0.886s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:49:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.8da2a78f-ef2c-47ff-951f-a79e438eb09f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:49:59 devstack sudo[102642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.8da2a78f-ef2c-47ff-951f-a79e438eb09f
Jun 26 05:49:59 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:49:59 devstack sudo[102641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ecc4053c-5888-4214-91bc-170176f5569f
Jun 26 05:49:59 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:00 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ecc4053c-5888-4214-91bc-170176f5569f" returned: 0 in 0.990s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ecc4053c-5888-4214-91bc-170176f5569f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:00 devstack sudo[102652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ecc4053c-5888-4214-91bc-170176f5569f
Jun 26 05:50:00 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:00 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.8da2a78f-ef2c-47ff-951f-a79e438eb09f" returned: 0 in 1.243s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.8da2a78f-ef2c-47ff-951f-a79e438eb09f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:01 devstack sudo[102660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.8da2a78f-ef2c-47ff-951f-a79e438eb09f
Jun 26 05:50:01 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:01 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ecc4053c-5888-4214-91bc-170176f5569f" returned: 0 in 0.886s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:01 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] Lock "cinder-quobyte-ecc4053c-5888-4214-91bc-170176f5569f" released by "delete_volume" :: held 1.950s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:50:01 devstack cinder-volume[93708]: WARNING cinder.quota [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-352251082 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-352251082, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:50:01 devstack cinder-volume[93708]: WARNING cinder.quota [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-352251082 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-352251082, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:50:01 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] Created reservations ['ff8ad4aa-32f5-4374-86e6-47a063014d67', 'f3a28314-d8d2-44d7-aab0-5672dad13831', 'e0478baa-2a3e-4c71-9b8f-f00190cdc0bc', 'd161aa33-8ba0-4bf3-aff7-d64161f729ad'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:50:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:50:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:50:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:01 devstack sudo[102698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:50:01 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:02 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6.8da2a78f-ef2c-47ff-951f-a79e438eb09f" returned: 0 in 1.092s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Lock "cinder-quobyte-8da2a78f-ef2c-47ff-951f-a79e438eb09f" released by "_delete_snapshot" :: held 4.291s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:50:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Lock "cinder-quobyte-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6" released by "delete_snapshot" :: held 4.342s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:50:02 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Created reservations ['e7f17dff-56de-4a1d-bce2-caff5a2ee630', 'fbd987a6-03a1-4d69-a4fa-5dcf1328e533', '83bdfe79-bd1f-4f72-a487-0606e8a3fc35', '9d90ad10-6d44-4e83-bf58-e09198037f73'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:50:02 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Delete snapshot completed successfully.
Jun 26 05:50:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-84b97fca-cc7f-43df-a4f0-99b8a0b538a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Lock "cinder-8da2a78f-ef2c-47ff-951f-a79e438eb09f-delete_snapshot" released by "delete_snapshot" :: held 4.552s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:50:02 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.073s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:02 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:50:02 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] Deleted volume successfully.
Jun 26 05:50:03 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6e4336f0-a9bb-440f-a861-5dc86966efa9 tempest-VolumeTypesAccessTest-1137755574 None] Lock "cinder-ecc4053c-5888-4214-91bc-170176f5569f-delete_volume" released by "delete_volume" :: held 3.413s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:50:03 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6b2b3e51-16e8-428d-84ca-afb9d67473ff tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Acquiring lock "cinder-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:50:03 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6b2b3e51-16e8-428d-84ca-afb9d67473ff tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Lock "cinder-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:50:03 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6b2b3e51-16e8-428d-84ca-afb9d67473ff tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Acquiring lock "cinder-quobyte-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:50:03 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6b2b3e51-16e8-428d-84ca-afb9d67473ff tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Lock "cinder-quobyte-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6" acquired by "delete_volume" :: waited 0.030s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:50:03 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5295c70-febe-4e95-8e7e-e921c2cf3898]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:50:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6b2b3e51-16e8-428d-84ca-afb9d67473ff tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:03 devstack sudo[102743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6
Jun 26 05:50:03 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:04 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6b2b3e51-16e8-428d-84ca-afb9d67473ff tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6" returned: 0 in 0.894s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6b2b3e51-16e8-428d-84ca-afb9d67473ff tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:04 devstack sudo[102751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6
Jun 26 05:50:04 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:05 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6b2b3e51-16e8-428d-84ca-afb9d67473ff tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6" returned: 0 in 0.755s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:05 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6b2b3e51-16e8-428d-84ca-afb9d67473ff tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Lock "cinder-quobyte-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6" released by "delete_volume" :: held 1.726s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:50:05 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-6b2b3e51-16e8-428d-84ca-afb9d67473ff tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Created reservations ['fbd5aada-a8b5-4952-ae49-62f82c12f902', '11e1cf9e-bdc2-40b9-bebd-7ed6acd34299', 'd701b3df-5af3-466d-941c-b406f1906aa2', '68c63070-0243-4620-9b0d-9cb15da4c383'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:50:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6b2b3e51-16e8-428d-84ca-afb9d67473ff tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6b2b3e51-16e8-428d-84ca-afb9d67473ff tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:05 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6b2b3e51-16e8-428d-84ca-afb9d67473ff tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:50:05 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6b2b3e51-16e8-428d-84ca-afb9d67473ff tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:50:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6b2b3e51-16e8-428d-84ca-afb9d67473ff tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6b2b3e51-16e8-428d-84ca-afb9d67473ff tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:05 devstack sudo[102754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:50:05 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:06 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6b2b3e51-16e8-428d-84ca-afb9d67473ff tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.168s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:06 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-6b2b3e51-16e8-428d-84ca-afb9d67473ff tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:50:06 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-6b2b3e51-16e8-428d-84ca-afb9d67473ff tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Deleted volume successfully.
Jun 26 05:50:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6b2b3e51-16e8-428d-84ca-afb9d67473ff tempest-VolumeSnapshotQuotasNegativeTestJSON-586808289 None] Lock "cinder-8d350d91-5ae4-4aba-a0dc-a27d804ac5f6-delete_volume" released by "delete_volume" :: held 3.251s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:50:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:50:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:50:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:50:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:10 devstack sudo[102761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:50:10 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:12 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.485s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:12 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:50:12 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:50:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 28 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:50:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>, <Thread(tpool_thread_0, started daemon 124035494721216)>, <Thread(tpool_thread_1, started daemon 124035486328512)>, <Thread(tpool_thread_2, started daemon 124035477919424)>, <Thread(tpool_thread_3, started daemon 124035469510336)>, <Thread(tpool_thread_4, started daemon 124035461101248)>, <Thread(tpool_thread_5, started daemon 124035452692160)>, <Thread(tpool_thread_6, started daemon 124035444283072)>, <Thread(tpool_thread_7, started daemon 124035435873984)>, <Thread(tpool_thread_8, started daemon 124035427464896)>, <Thread(tpool_thread_9, started daemon 124035419055808)>, <Thread(tpool_thread_10, started daemon 124035410646720)>, <Thread(tpool_thread_11, started daemon 124035402237632)>, <Thread(tpool_thread_12, started daemon 124035393828544)>, <Thread(tpool_thread_13, started daemon 124035385419456)>, <Thread(tpool_thread_14, started daemon 124035377010368)>, <Thread(tpool_thread_15, started daemon 124035368601280)>, <Thread(tpool_thread_16, started daemon 124035360192192)>, <Thread(tpool_thread_17, started daemon 124035351783104)>, <Thread(tpool_thread_18, started daemon 124035343374016)>, <Thread(tpool_thread_19, started daemon 124035334964928)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:50:15 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=46,cinder:UPDATE=61,cinder:INSERT=19,cinder:DELETE=3 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:50:16 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=56,cinder:SELECT=50,cinder:INSERT=10,cinder:DELETE=6 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Flow 'volume_create_manager' (0e4eee9b-2628-4b37-a064-dfcced214eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4001acfb-8d3b-4b7f-9567-22971ae97e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4001acfb-8d3b-4b7f-9567-22971ae97e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-129555876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae51433-0a2e-4458-86ed-5f137f9e6cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46596264b90c455d9b744ccff72df483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:50:17Z,use_quota=True,user_id='7e4ff5e154eb498a95100207d41132b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2795a2b4-6333-4469-acdf-b01a92889cd2),volume_type_id=2795a2b4-6333-4469-acdf-b01a92889cd2)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c088190c-a5ca-4260-9384-44f885a33f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c088190c-a5ca-4260-9384-44f885a33f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3ac79a-51b8-4a8d-8f63-33abc1d54449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3ac79a-51b8-4a8d-8f63-33abc1d54449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aae51433-0a2e-4458-86ed-5f137f9e6cfd', 'volume_name': 'volume-aae51433-0a2e-4458-86ed-5f137f9e6cfd', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8a9efd-537e-4117-924d-11f595a39223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8a9efd-537e-4117-924d-11f595a39223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a9cca2-e3e2-4e8f-a630-1e9d3c113071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:17 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Volume aae51433-0a2e-4458-86ed-5f137f9e6cfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aae51433-0a2e-4458-86ed-5f137f9e6cfd', 'volume_size': 1}
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-129555876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae51433-0a2e-4458-86ed-5f137f9e6cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46596264b90c455d9b744ccff72df483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:50:17Z,use_quota=True,user_id='7e4ff5e154eb498a95100207d41132b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2795a2b4-6333-4469-acdf-b01a92889cd2),volume_type_id=2795a2b4-6333-4469-acdf-b01a92889cd2)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Creating volume aae51433-0a2e-4458-86ed-5f137f9e6cfd {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:50:17 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:50:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aae51433-0a2e-4458-86ed-5f137f9e6cfd 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:17 devstack sudo[102768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aae51433-0a2e-4458-86ed-5f137f9e6cfd 1073741824
Jun 26 05:50:17 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:18 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:50:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Flow 'volume_create_manager' (ea250da7-2138-45fb-b8eb-b96955282d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:50:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5ef563-3ae2-42a7-a06e-c634e410aae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5ef563-3ae2-42a7-a06e-c634e410aae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1557811419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e06ab3-f7f0-4949-b79a-81bb173f2c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46596264b90c455d9b744ccff72df483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:50:18Z,use_quota=True,user_id='7e4ff5e154eb498a95100207d41132b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4f06478-c0df-446e-80b3-5337c4af5686),volume_type_id=f4f06478-c0df-446e-80b3-5337c4af5686)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f50b6e9-b8af-482e-900b-309fb6271f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f50b6e9-b8af-482e-900b-309fb6271f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf3242c-2744-47f8-8e81-0d2fe054cc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf3242c-2744-47f8-8e81-0d2fe054cc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92e06ab3-f7f0-4949-b79a-81bb173f2c06', 'volume_name': 'volume-92e06ab3-f7f0-4949-b79a-81bb173f2c06', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99937153-8862-4651-a682-adb7b4ba45c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99937153-8862-4651-a682-adb7b4ba45c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6989fd-0d89-444c-b300-254931606c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:18 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Volume 92e06ab3-f7f0-4949-b79a-81bb173f2c06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92e06ab3-f7f0-4949-b79a-81bb173f2c06', 'volume_size': 1}
Jun 26 05:50:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:18 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aae51433-0a2e-4458-86ed-5f137f9e6cfd 1073741824" returned: 0 in 1.648s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aae51433-0a2e-4458-86ed-5f137f9e6cfd {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:18 devstack sudo[102794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aae51433-0a2e-4458-86ed-5f137f9e6cfd
Jun 26 05:50:18 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Flow 'volume_create_manager' (a00a1062-9b17-4d53-8c11-edd91dc2f4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8a912f-1a71-49d6-a945-48a6c5084079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8a912f-1a71-49d6-a945-48a6c5084079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-984878907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf45398-92a9-486c-a2be-cc4ce7aa44d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46596264b90c455d9b744ccff72df483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:50:19Z,use_quota=True,user_id='7e4ff5e154eb498a95100207d41132b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1292df37-e9f0-46cb-9ca1-3c1608369c46),volume_type_id=1292df37-e9f0-46cb-9ca1-3c1608369c46)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a61c4a-4ae2-4fd0-b356-fa24c5c6fe66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a61c4a-4ae2-4fd0-b356-fa24c5c6fe66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdeabd3-82c8-486f-9dd8-d4d5f586be8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG cinder.image.glance [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Creating Keystone auth plugin from conf {{(pid=93708) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdeabd3-82c8-486f-9dd8-d4d5f586be8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'daf45398-92a9-486c-a2be-cc4ce7aa44d5', 'volume_name': 'volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5', 'volume_size': 1, 'image_id': 'ef7e16e5-2721-40ca-9994-9b3d5c0623c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ef7e16e5-2721-40ca-9994-9b3d5c0623c2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1403770153', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46596264b90c455d9b744ccff72df483', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ef7e16e5-2721-40ca-9994-9b3d5c0623c2', 'created_at': datetime.datetime(2026, 6, 26, 3, 50, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 3, 50, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ef7e16e5-2721-40ca-9994-9b3d5c0623c2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf43b3b470>}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4f18af-fc10-4709-a17e-ec44b976f2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4f18af-fc10-4709-a17e-ec44b976f2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f471cf29-94eb-4aff-bf9a-7fbb61244bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:19 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Volume daf45398-92a9-486c-a2be-cc4ce7aa44d5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5', 'volume_size': 1, 'image_id': 'ef7e16e5-2721-40ca-9994-9b3d5c0623c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ef7e16e5-2721-40ca-9994-9b3d5c0623c2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1403770153', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46596264b90c455d9b744ccff72df483', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ef7e16e5-2721-40ca-9994-9b3d5c0623c2', 'created_at': datetime.datetime(2026, 6, 26, 3, 50, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 3, 50, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ef7e16e5-2721-40ca-9994-9b3d5c0623c2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf43b3b470>}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Trying to clone daf45398-92a9-486c-a2be-cc4ce7aa44d5 from image ef7e16e5-2721-40ca-9994-9b3d5c0623c2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ef7e16e5-2721-40ca-9994-9b3d5c0623c2', 'metadata': {}}]). {{(pid=93708) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 26 05:50:19 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aae51433-0a2e-4458-86ed-5f137f9e6cfd" returned: 0 in 0.998s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] <== create_volume: return (2742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.747s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.763s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1557811419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e06ab3-f7f0-4949-b79a-81bb173f2c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46596264b90c455d9b744ccff72df483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:50:18Z,use_quota=True,user_id='7e4ff5e154eb498a95100207d41132b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4f06478-c0df-446e-80b3-5337c4af5686),volume_type_id=f4f06478-c0df-446e-80b3-5337c4af5686)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Creating volume 92e06ab3-f7f0-4949-b79a-81bb173f2c06 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:50:19 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:50:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-92e06ab3-f7f0-4949-b79a-81bb173f2c06 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:20 devstack sudo[102797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-92e06ab3-f7f0-4949-b79a-81bb173f2c06 1073741824
Jun 26 05:50:20 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a9cca2-e3e2-4e8f-a630-1e9d3c113071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aae51433-0a2e-4458-86ed-5f137f9e6cfd', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c88a919-0f03-46e8-ba46-4a1f84a7d2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:20 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Volume volume-aae51433-0a2e-4458-86ed-5f137f9e6cfd (aae51433-0a2e-4458-86ed-5f137f9e6cfd): created successfully
Jun 26 05:50:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c88a919-0f03-46e8-ba46-4a1f84a7d2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Flow 'volume_create_manager' (0e4eee9b-2628-4b37-a064-dfcced214eef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:50:20 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-97eccdde-a7e1-4aea-acf8-094ec088310c tempest-TestInstancesWithCinderVolumes-1417758814 None] Created volume successfully.
Jun 26 05:50:21 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-92e06ab3-f7f0-4949-b79a-81bb173f2c06 1073741824" returned: 0 in 1.076s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-92e06ab3-f7f0-4949-b79a-81bb173f2c06 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:21 devstack sudo[102803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-92e06ab3-f7f0-4949-b79a-81bb173f2c06
Jun 26 05:50:21 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:21 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-92e06ab3-f7f0-4949-b79a-81bb173f2c06" returned: 0 in 0.803s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:50:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6989fd-0d89-444c-b300-254931606c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e06ab3-f7f0-4949-b79a-81bb173f2c06', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b595df2f-1105-4cfe-bbe2-94a15372ed49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:21 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Volume volume-92e06ab3-f7f0-4949-b79a-81bb173f2c06 (92e06ab3-f7f0-4949-b79a-81bb173f2c06): created successfully
Jun 26 05:50:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b595df2f-1105-4cfe-bbe2-94a15372ed49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Flow 'volume_create_manager' (ea250da7-2138-45fb-b8eb-b96955282d65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:50:21 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-61b30d3f-5c19-4857-88d8-29f46e86edae tempest-TestInstancesWithCinderVolumes-1417758814 None] Created volume successfully.
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ef7e16e5-2721-40ca-9994-9b3d5c0623c2_a1wbubtqdevstack@QuobyteHD, size 20.69 MB, duration 4.25 sec {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 26 05:50:24 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Image download 20.69 MB at 4.86 MB/s
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f52e42d-93c9-4d00-ad85-c3d8fcf423da]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ef7e16e5-2721-40ca-9994-9b3d5c0623c2_a1wbubtqdevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:24 devstack sudo[102821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ef7e16e5-2721-40ca-9994-9b3d5c0623c2_a1wbubtqdevstack@QuobyteHD
Jun 26 05:50:24 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Flow 'volume_create_manager' (b0f0e287-f372-4202-9711-8a0feed3950f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a8ba84-2549-4002-9232-bcef837aeb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a8ba84-2549-4002-9232-bcef837aeb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2115526228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd9c9ae-88b9-4b51-821b-b546f9a80d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69599977f41c42c89c1abe5a27a98d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:50:25Z,use_quota=True,user_id='e6118857b02840228784ddd84a067f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fec4d6-bcf3-4356-9761-6a043b83b625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fec4d6-bcf3-4356-9761-6a043b83b625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507a610c-fbcc-4329-ba83-fdda7646077c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507a610c-fbcc-4329-ba83-fdda7646077c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fd9c9ae-88b9-4b51-821b-b546f9a80d70', 'volume_name': 'volume-2fd9c9ae-88b9-4b51-821b-b546f9a80d70', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8bd86a-11e2-426c-abf6-dbbe124bf92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8bd86a-11e2-426c-abf6-dbbe124bf92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c8b9fe8-f393-4344-8a8c-89f117dab5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:24 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Volume 2fd9c9ae-88b9-4b51-821b-b546f9a80d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fd9c9ae-88b9-4b51-821b-b546f9a80d70', 'volume_size': 1}
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2115526228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd9c9ae-88b9-4b51-821b-b546f9a80d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69599977f41c42c89c1abe5a27a98d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:50:25Z,use_quota=True,user_id='e6118857b02840228784ddd84a067f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Creating volume 2fd9c9ae-88b9-4b51-821b-b546f9a80d70 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:50:24 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:50:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2fd9c9ae-88b9-4b51-821b-b546f9a80d70 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:24 devstack sudo[102845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2fd9c9ae-88b9-4b51-821b-b546f9a80d70 1073741824
Jun 26 05:50:24 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:25 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ef7e16e5-2721-40ca-9994-9b3d5c0623c2_a1wbubtqdevstack@QuobyteHD" returned: 0 in 0.898s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:25 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Temporary image ef7e16e5-2721-40ca-9994-9b3d5c0623c2 is fetched for user 7e4ff5e154eb498a95100207d41132b2. {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 26 05:50:25 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e00287-644c-4719-8a24-6d053a24ec1e]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:50:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ef7e16e5-2721-40ca-9994-9b3d5c0623c2_a1wbubtqdevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:25 devstack sudo[102850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ef7e16e5-2721-40ca-9994-9b3d5c0623c2_a1wbubtqdevstack@QuobyteHD
Jun 26 05:50:25 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:25 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2fd9c9ae-88b9-4b51-821b-b546f9a80d70 1073741824" returned: 0 in 0.979s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2fd9c9ae-88b9-4b51-821b-b546f9a80d70 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:25 devstack sudo[102857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2fd9c9ae-88b9-4b51-821b-b546f9a80d70
Jun 26 05:50:25 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:25 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ef7e16e5-2721-40ca-9994-9b3d5c0623c2_a1wbubtqdevstack@QuobyteHD" returned: 0 in 0.852s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:26 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2fd9c9ae-88b9-4b51-821b-b546f9a80d70" returned: 0 in 0.696s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:50:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.530s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-984878907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf45398-92a9-486c-a2be-cc4ce7aa44d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46596264b90c455d9b744ccff72df483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:50:19Z,use_quota=True,user_id='7e4ff5e154eb498a95100207d41132b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1292df37-e9f0-46cb-9ca1-3c1608369c46),volume_type_id=1292df37-e9f0-46cb-9ca1-3c1608369c46)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:50:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Creating volume daf45398-92a9-486c-a2be-cc4ce7aa44d5 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:50:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:50:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:50:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:50:26 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:50:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:26 devstack sudo[102864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5 1073741824
Jun 26 05:50:26 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c8b9fe8-f393-4344-8a8c-89f117dab5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd9c9ae-88b9-4b51-821b-b546f9a80d70', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9df7013-8dda-48be-b1e1-66c2ce05d0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:26 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Volume volume-2fd9c9ae-88b9-4b51-821b-b546f9a80d70 (2fd9c9ae-88b9-4b51-821b-b546f9a80d70): created successfully
Jun 26 05:50:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9df7013-8dda-48be-b1e1-66c2ce05d0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Flow 'volume_create_manager' (b0f0e287-f372-4202-9711-8a0feed3950f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:50:26 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-adfeecf8-68fa-41dc-8661-5781ab501f76 tempest-VolumesListAdminTestJSON-1405208235 None] Created volume successfully.
Jun 26 05:50:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5 1073741824" returned: 0 in 0.911s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:27 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:27 devstack sudo[102870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5
Jun 26 05:50:27 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:28 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5" returned: 0 in 0.841s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Attempting download of ef7e16e5-2721-40ca-9994-9b3d5c0623c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/ef7e16e5-2721-40ca-9994-9b3d5c0623c2', 'metadata': {}}])) to volume daf45398-92a9-486c-a2be-cc4ce7aa44d5. {{(pid=93708) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Flow 'volume_create_manager' (0c6efe57-6ed5-4f5d-8a66-1a0d6fad47cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ba1c73-a22a-4519-95b2-8b42d5306fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c42ec2-f257-4a60-a5bf-33d5631cc0da]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ef7e16e5-2721-40ca-9994-9b3d5c0623c2_nyfg7p27 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ba1c73-a22a-4519-95b2-8b42d5306fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-859825436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c993c4c-18a6-4b79-bb89-d1e92a5900c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69599977f41c42c89c1abe5a27a98d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:50:28Z,use_quota=True,user_id='e6118857b02840228784ddd84a067f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c4e10d9-dce7-4cd1-8f96-4c2423474dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c4e10d9-dce7-4cd1-8f96-4c2423474dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (032eb1a2-f03c-487b-abc8-48ccc50e0cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (032eb1a2-f03c-487b-abc8-48ccc50e0cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c993c4c-18a6-4b79-bb89-d1e92a5900c2', 'volume_name': 'volume-9c993c4c-18a6-4b79-bb89-d1e92a5900c2', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979146e9-aa72-485c-94f0-e7687f56c09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979146e9-aa72-485c-94f0-e7687f56c09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ca05a7-b675-4a2b-bcf2-6cd76ba68105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:28 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Volume 9c993c4c-18a6-4b79-bb89-d1e92a5900c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c993c4c-18a6-4b79-bb89-d1e92a5900c2', 'volume_size': 1}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-859825436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c993c4c-18a6-4b79-bb89-d1e92a5900c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69599977f41c42c89c1abe5a27a98d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:50:28Z,use_quota=True,user_id='e6118857b02840228784ddd84a067f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Creating volume 9c993c4c-18a6-4b79-bb89-d1e92a5900c2 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:50:28 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:50:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c993c4c-18a6-4b79-bb89-d1e92a5900c2 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:28 devstack sudo[102873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ef7e16e5-2721-40ca-9994-9b3d5c0623c2_nyfg7p27
Jun 26 05:50:28 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:28 devstack sudo[102874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c993c4c-18a6-4b79-bb89-d1e92a5900c2 1073741824
Jun 26 05:50:28 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:29 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ef7e16e5-2721-40ca-9994-9b3d5c0623c2_nyfg7p27" returned: 0 in 0.757s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ef7e16e5-2721-40ca-9994-9b3d5c0623c2_nyfg7p27 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:29 devstack sudo[102882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ef7e16e5-2721-40ca-9994-9b3d5c0623c2_nyfg7p27
Jun 26 05:50:29 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:29 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c993c4c-18a6-4b79-bb89-d1e92a5900c2 1073741824" returned: 0 in 0.954s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c993c4c-18a6-4b79-bb89-d1e92a5900c2 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:29 devstack sudo[102885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c993c4c-18a6-4b79-bb89-d1e92a5900c2
Jun 26 05:50:29 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:30 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ef7e16e5-2721-40ca-9994-9b3d5c0623c2_nyfg7p27" returned: 1 in 0.838s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ef7e16e5-2721-40ca-9994-9b3d5c0623c2_nyfg7p27' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 05:50:30 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e3360a-e3c0-4075-8594-6b44e9ae2b67]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:50:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ef7e16e5-2721-40ca-9994-9b3d5c0623c2_a1wbubtqdevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:30 devstack sudo[102889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ef7e16e5-2721-40ca-9994-9b3d5c0623c2_a1wbubtqdevstack@QuobyteHD
Jun 26 05:50:30 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:30 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c993c4c-18a6-4b79-bb89-d1e92a5900c2" returned: 0 in 0.787s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:30 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:50:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ca05a7-b675-4a2b-bcf2-6cd76ba68105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c993c4c-18a6-4b79-bb89-d1e92a5900c2', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5199964e-330a-4974-a9ec-16fe8cc8017c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:30 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Volume volume-9c993c4c-18a6-4b79-bb89-d1e92a5900c2 (9c993c4c-18a6-4b79-bb89-d1e92a5900c2): created successfully
Jun 26 05:50:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5199964e-330a-4974-a9ec-16fe8cc8017c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Flow 'volume_create_manager' (0c6efe57-6ed5-4f5d-8a66-1a0d6fad47cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:50:30 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-71873b6e-06e6-4631-bdcb-bad5363596ca tempest-VolumesListAdminTestJSON-1405208235 None] Created volume successfully.
Jun 26 05:50:30 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ef7e16e5-2721-40ca-9994-9b3d5c0623c2_a1wbubtqdevstack@QuobyteHD" returned: 0 in 0.920s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:30 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] ef7e16e5-2721-40ca-9994-9b3d5c0623c2 was qcow2, converting to raw {{(pid=93708) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 26 05:50:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ef7e16e5-2721-40ca-9994-9b3d5c0623c2_a1wbubtqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:31 devstack sudo[102895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ef7e16e5-2721-40ca-9994-9b3d5c0623c2_a1wbubtqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5
Jun 26 05:50:31 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Flow 'volume_create_manager' (3994fc44-38c6-4dd9-adab-d495d5a7d8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d217bfc-df20-445b-95cf-31a76601c09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d217bfc-df20-445b-95cf-31a76601c09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-150996646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74178a01-599a-45e6-bbbc-0602ab2cf359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69599977f41c42c89c1abe5a27a98d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:50:31Z,use_quota=True,user_id='e6118857b02840228784ddd84a067f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5ac633-a0d4-4109-afd4-c0e56e65c962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5ac633-a0d4-4109-afd4-c0e56e65c962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1cd5eac-fc69-46d8-b6b6-7ced1e136f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1cd5eac-fc69-46d8-b6b6-7ced1e136f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74178a01-599a-45e6-bbbc-0602ab2cf359', 'volume_name': 'volume-74178a01-599a-45e6-bbbc-0602ab2cf359', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24024a44-5170-4edf-b6fc-4ffbdc6ca37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24024a44-5170-4edf-b6fc-4ffbdc6ca37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b9b1ea-c094-4614-82d0-d53f7727e0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:31 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Volume 74178a01-599a-45e6-bbbc-0602ab2cf359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74178a01-599a-45e6-bbbc-0602ab2cf359', 'volume_size': 1}
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-150996646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74178a01-599a-45e6-bbbc-0602ab2cf359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69599977f41c42c89c1abe5a27a98d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:50:31Z,use_quota=True,user_id='e6118857b02840228784ddd84a067f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Creating volume 74178a01-599a-45e6-bbbc-0602ab2cf359 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:50:31 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:50:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-74178a01-599a-45e6-bbbc-0602ab2cf359 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:31 devstack sudo[102897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-74178a01-599a-45e6-bbbc-0602ab2cf359 1073741824
Jun 26 05:50:31 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:32 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-74178a01-599a-45e6-bbbc-0602ab2cf359 1073741824" returned: 0 in 1.087s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-74178a01-599a-45e6-bbbc-0602ab2cf359 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:32 devstack sudo[102912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-74178a01-599a-45e6-bbbc-0602ab2cf359
Jun 26 05:50:32 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:33 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-74178a01-599a-45e6-bbbc-0602ab2cf359" returned: 0 in 1.006s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] <== create_volume: return (2144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.147s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b9b1ea-c094-4614-82d0-d53f7727e0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74178a01-599a-45e6-bbbc-0602ab2cf359', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06239de2-8685-4997-a663-ff7da424efc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:33 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Volume volume-74178a01-599a-45e6-bbbc-0602ab2cf359 (74178a01-599a-45e6-bbbc-0602ab2cf359): created successfully
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06239de2-8685-4997-a663-ff7da424efc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Flow 'volume_create_manager' (3994fc44-38c6-4dd9-adab-d495d5a7d8db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:50:33 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-7b4ec570-d19b-4976-819f-73f69249b6ee tempest-VolumesListAdminTestJSON-1405208235 None] Created volume successfully.
Jun 26 05:50:33 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ef7e16e5-2721-40ca-9994-9b3d5c0623c2_a1wbubtqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5" returned: 0 in 2.529s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ef7e16e5-2721-40ca-9994-9b3d5c0623c2_a1wbubtqdevstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5 {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 05:50:33 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Converted 112.00 MB image at 44.25 MB/s
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:33 devstack sudo[102917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5 1G
Jun 26 05:50:33 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Flow 'volume_create_manager' (569fdb33-f9ca-4b97-b43d-94f520b11f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d81bc3b-048a-4326-a7a0-195f7bcb7d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d81bc3b-048a-4326-a7a0-195f7bcb7d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1364353509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ec87da-844b-4085-bfe5-0edda573cf64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad43f02466524bf1a0cbd95bc7de35b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:50:34Z,use_quota=True,user_id='8e5cac8a1d734889b9ba485b7d88a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a583252d-ab38-4fea-90c7-836e84f62cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a583252d-ab38-4fea-90c7-836e84f62cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b60beb-e72e-4eda-ba12-a14863bd9d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b60beb-e72e-4eda-ba12-a14863bd9d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6ec87da-844b-4085-bfe5-0edda573cf64', 'volume_name': 'volume-c6ec87da-844b-4085-bfe5-0edda573cf64', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1f088e-4c76-4fe2-94f9-115dcea9c215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1f088e-4c76-4fe2-94f9-115dcea9c215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ab1c1b-4d54-41b9-92c9-6d4e48fe248a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:33 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Volume c6ec87da-844b-4085-bfe5-0edda573cf64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6ec87da-844b-4085-bfe5-0edda573cf64', 'volume_size': 1}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1364353509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ec87da-844b-4085-bfe5-0edda573cf64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad43f02466524bf1a0cbd95bc7de35b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:50:34Z,use_quota=True,user_id='8e5cac8a1d734889b9ba485b7d88a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Creating volume c6ec87da-844b-4085-bfe5-0edda573cf64 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:50:33 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:50:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c6ec87da-844b-4085-bfe5-0edda573cf64 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:33 devstack sudo[102919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c6ec87da-844b-4085-bfe5-0edda573cf64 1073741824
Jun 26 05:50:33 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:34 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5 1G" returned: 0 in 0.816s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:34 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[033e9302-0aca-4ccc-8c23-ab54a6fc172b]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:50:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:34 devstack sudo[102924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5
Jun 26 05:50:34 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:34 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c6ec87da-844b-4085-bfe5-0edda573cf64 1073741824" returned: 0 in 1.022s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c6ec87da-844b-4085-bfe5-0edda573cf64 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:35 devstack sudo[102930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c6ec87da-844b-4085-bfe5-0edda573cf64
Jun 26 05:50:35 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:35 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5" returned: 0 in 1.004s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Flow 'volume_create_manager' (a35f4718-f222-45a2-aced-97ba43334df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b257636-38f5-4d7f-8da8-3955749a3c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b257636-38f5-4d7f-8da8-3955749a3c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c229f48-8d35-4480-a4d2-5da47c339160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c596069f32054fc98ab6dcfbb5ca57a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:50:35Z,use_quota=True,user_id='1ea67a01ab894ccc925f47029ce7f1e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd09afff-1237-4022-88e8-c7eb591eadd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd09afff-1237-4022-88e8-c7eb591eadd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146fdb64-39ec-4da6-9607-38d568cf06a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146fdb64-39ec-4da6-9607-38d568cf06a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c229f48-8d35-4480-a4d2-5da47c339160', 'volume_name': 'volume-9c229f48-8d35-4480-a4d2-5da47c339160', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1450a01-e98d-4161-b0da-9a9e06c3e7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1450a01-e98d-4161-b0da-9a9e06c3e7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410a734c-d1b4-403b-8869-e4582892c827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:35 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Volume 9c229f48-8d35-4480-a4d2-5da47c339160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c229f48-8d35-4480-a4d2-5da47c339160', 'volume_size': 1}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:35 devstack sudo[102934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5
Jun 26 05:50:35 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:35 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c6ec87da-844b-4085-bfe5-0edda573cf64" returned: 0 in 0.904s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] <== create_volume: return (1976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.348s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c229f48-8d35-4480-a4d2-5da47c339160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c596069f32054fc98ab6dcfbb5ca57a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:50:35Z,use_quota=True,user_id='1ea67a01ab894ccc925f47029ce7f1e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Creating volume 9c229f48-8d35-4480-a4d2-5da47c339160 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:50:35 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c229f48-8d35-4480-a4d2-5da47c339160 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ab1c1b-4d54-41b9-92c9-6d4e48fe248a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ec87da-844b-4085-bfe5-0edda573cf64', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64684ba3-3e00-42fd-99eb-c9c2e26728db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:35 devstack sudo[102937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c229f48-8d35-4480-a4d2-5da47c339160 1073741824
Jun 26 05:50:35 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:36 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Volume volume-c6ec87da-844b-4085-bfe5-0edda573cf64 (c6ec87da-844b-4085-bfe5-0edda573cf64): created successfully
Jun 26 05:50:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64684ba3-3e00-42fd-99eb-c9c2e26728db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Flow 'volume_create_manager' (569fdb33-f9ca-4b97-b43d-94f520b11f8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:50:36 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-d9e9460a-5bff-45d8-8279-51f19147a495 tempest-AttachVolumeTestJSON-1893104206 None] Created volume successfully.
Jun 26 05:50:36 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5" returned: 1 in 0.883s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 05:50:36 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Downloaded image ef7e16e5-2721-40ca-9994-9b3d5c0623c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/ef7e16e5-2721-40ca-9994-9b3d5c0623c2', 'metadata': {}}])) to volume daf45398-92a9-486c-a2be-cc4ce7aa44d5 successfully. {{(pid=93708) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 26 05:50:36 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Temporary image ef7e16e5-2721-40ca-9994-9b3d5c0623c2 for user 7e4ff5e154eb498a95100207d41132b2 is deleted. {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 26 05:50:36 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Marking volume daf45398-92a9-486c-a2be-cc4ce7aa44d5 as bootable. {{(pid=93708) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 26 05:50:36 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Copying metadata from image ef7e16e5-2721-40ca-9994-9b3d5c0623c2 to daf45398-92a9-486c-a2be-cc4ce7aa44d5. {{(pid=93708) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 26 05:50:36 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Creating volume glance metadata for volume daf45398-92a9-486c-a2be-cc4ce7aa44d5 backed by image ef7e16e5-2721-40ca-9994-9b3d5c0623c2 with: {'image_id': 'ef7e16e5-2721-40ca-9994-9b3d5c0623c2', 'image_name': 'tempest-scenario-img--1403770153', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93708) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 26 05:50:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f471cf29-94eb-4aff-bf9a-7fbb61244bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5', 'volume_size': 1, 'image_id': 'ef7e16e5-2721-40ca-9994-9b3d5c0623c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ef7e16e5-2721-40ca-9994-9b3d5c0623c2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1403770153', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46596264b90c455d9b744ccff72df483', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ef7e16e5-2721-40ca-9994-9b3d5c0623c2', 'created_at': datetime.datetime(2026, 6, 26, 3, 50, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 3, 50, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ef7e16e5-2721-40ca-9994-9b3d5c0623c2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf43b3b470>}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7afd304-cce3-49fe-98ff-5ad6f15cbe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:36 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Volume volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5 (daf45398-92a9-486c-a2be-cc4ce7aa44d5): created successfully
Jun 26 05:50:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7afd304-cce3-49fe-98ff-5ad6f15cbe04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Flow 'volume_create_manager' (a00a1062-9b17-4d53-8c11-edd91dc2f4f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:50:36 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-fbcc2d22-113e-4c47-a999-7457eabd0cee tempest-TestInstancesWithCinderVolumes-1417758814 None] Created volume successfully.
Jun 26 05:50:36 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c229f48-8d35-4480-a4d2-5da47c339160 1073741824" returned: 0 in 0.950s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c229f48-8d35-4480-a4d2-5da47c339160 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:36 devstack sudo[102946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c229f48-8d35-4480-a4d2-5da47c339160
Jun 26 05:50:36 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:37 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c229f48-8d35-4480-a4d2-5da47c339160" returned: 0 in 0.751s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:37 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:50:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410a734c-d1b4-403b-8869-e4582892c827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c229f48-8d35-4480-a4d2-5da47c339160', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c43c91ef-90f1-4237-a561-e83c04635fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:37 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Volume volume-9c229f48-8d35-4480-a4d2-5da47c339160 (9c229f48-8d35-4480-a4d2-5da47c339160): created successfully
Jun 26 05:50:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c43c91ef-90f1-4237-a561-e83c04635fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Flow 'volume_create_manager' (a35f4718-f222-45a2-aced-97ba43334df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:50:37 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-af2acc9d-e980-4408-b980-33359fce58bd tempest-VolumesListAdminTestJSON-1893721304 None] Created volume successfully.
Jun 26 05:50:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-97252b92-2745-484f-a9e4-8b39152fcaf7 tempest-VolumesListAdminTestJSON-1893721304 None] Acquiring lock "cinder-9c229f48-8d35-4480-a4d2-5da47c339160-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:50:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-97252b92-2745-484f-a9e4-8b39152fcaf7 tempest-VolumesListAdminTestJSON-1893721304 None] Lock "cinder-9c229f48-8d35-4480-a4d2-5da47c339160-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:50:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-97252b92-2745-484f-a9e4-8b39152fcaf7 tempest-VolumesListAdminTestJSON-1893721304 None] Acquiring lock "cinder-quobyte-9c229f48-8d35-4480-a4d2-5da47c339160" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:50:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-97252b92-2745-484f-a9e4-8b39152fcaf7 tempest-VolumesListAdminTestJSON-1893721304 None] Lock "cinder-quobyte-9c229f48-8d35-4480-a4d2-5da47c339160" acquired by "delete_volume" :: waited 0.017s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:50:38 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af02bcc-a541-4920-8ec6-c80005ba6597]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:50:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-97252b92-2745-484f-a9e4-8b39152fcaf7 tempest-VolumesListAdminTestJSON-1893721304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c229f48-8d35-4480-a4d2-5da47c339160 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-13fb2f20-b31d-4254-931b-d2883ca58c2c tempest-VolumesListAdminTestJSON-1405208235 None] Acquiring lock "cinder-74178a01-599a-45e6-bbbc-0602ab2cf359-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:50:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-13fb2f20-b31d-4254-931b-d2883ca58c2c tempest-VolumesListAdminTestJSON-1405208235 None] Lock "cinder-74178a01-599a-45e6-bbbc-0602ab2cf359-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:50:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-13fb2f20-b31d-4254-931b-d2883ca58c2c tempest-VolumesListAdminTestJSON-1405208235 None] Acquiring lock "cinder-quobyte-74178a01-599a-45e6-bbbc-0602ab2cf359" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:50:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-13fb2f20-b31d-4254-931b-d2883ca58c2c tempest-VolumesListAdminTestJSON-1405208235 None] Lock "cinder-quobyte-74178a01-599a-45e6-bbbc-0602ab2cf359" acquired by "delete_volume" :: waited 0.034s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:50:39 devstack sudo[102957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c229f48-8d35-4480-a4d2-5da47c339160
Jun 26 05:50:39 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:39 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ec24fd-ca83-4a92-9e00-46470e38b6ab]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:50:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-13fb2f20-b31d-4254-931b-d2883ca58c2c tempest-VolumesListAdminTestJSON-1405208235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-74178a01-599a-45e6-bbbc-0602ab2cf359 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:39 devstack sudo[102959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-74178a01-599a-45e6-bbbc-0602ab2cf359
Jun 26 05:50:39 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:40 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-97252b92-2745-484f-a9e4-8b39152fcaf7 tempest-VolumesListAdminTestJSON-1893721304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c229f48-8d35-4480-a4d2-5da47c339160" returned: 0 in 1.154s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-97252b92-2745-484f-a9e4-8b39152fcaf7 tempest-VolumesListAdminTestJSON-1893721304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c229f48-8d35-4480-a4d2-5da47c339160 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:40 devstack sudo[102965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c229f48-8d35-4480-a4d2-5da47c339160
Jun 26 05:50:40 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:40 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-13fb2f20-b31d-4254-931b-d2883ca58c2c tempest-VolumesListAdminTestJSON-1405208235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-74178a01-599a-45e6-bbbc-0602ab2cf359" returned: 0 in 1.297s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-13fb2f20-b31d-4254-931b-d2883ca58c2c tempest-VolumesListAdminTestJSON-1405208235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-74178a01-599a-45e6-bbbc-0602ab2cf359 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:40 devstack sudo[102970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-74178a01-599a-45e6-bbbc-0602ab2cf359
Jun 26 05:50:40 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-22976589-b9d0-4fb9-9a1c-3c0bb2228aa4 req-73c6ad03-9f91-4f6f-9ca4-4030f37cd363 tempest-AttachVolumeTestJSON-1893104206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-22976589-b9d0-4fb9-9a1c-3c0bb2228aa4 req-73c6ad03-9f91-4f6f-9ca4-4030f37cd363 tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:40 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3516a9-1383-4096-9711-2c512694193a]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:50:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-22976589-b9d0-4fb9-9a1c-3c0bb2228aa4 req-73c6ad03-9f91-4f6f-9ca4-4030f37cd363 tempest-AttachVolumeTestJSON-1893104206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c6ec87da-844b-4085-bfe5-0edda573cf64 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:40 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-97252b92-2745-484f-a9e4-8b39152fcaf7 tempest-VolumesListAdminTestJSON-1893721304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c229f48-8d35-4480-a4d2-5da47c339160" returned: 0 in 0.830s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-97252b92-2745-484f-a9e4-8b39152fcaf7 tempest-VolumesListAdminTestJSON-1893721304 None] Lock "cinder-quobyte-9c229f48-8d35-4480-a4d2-5da47c339160" released by "delete_volume" :: held 2.047s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:50:40 devstack sudo[102981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c6ec87da-844b-4085-bfe5-0edda573cf64
Jun 26 05:50:40 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:40 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-97252b92-2745-484f-a9e4-8b39152fcaf7 tempest-VolumesListAdminTestJSON-1893721304 None] Created reservations ['850d0e84-6522-44a7-8fa5-bde8e2d57e7a', '09d63cc5-a190-46a9-b9f0-c863c692f39c', 'f5667a88-b163-4139-a464-8bce38107e53', 'd71231c6-d95b-4bb6-b06a-f82710f1e633'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:50:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-97252b92-2745-484f-a9e4-8b39152fcaf7 tempest-VolumesListAdminTestJSON-1893721304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-97252b92-2745-484f-a9e4-8b39152fcaf7 tempest-VolumesListAdminTestJSON-1893721304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-97252b92-2745-484f-a9e4-8b39152fcaf7 tempest-VolumesListAdminTestJSON-1893721304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:50:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-97252b92-2745-484f-a9e4-8b39152fcaf7 tempest-VolumesListAdminTestJSON-1893721304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:50:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-97252b92-2745-484f-a9e4-8b39152fcaf7 tempest-VolumesListAdminTestJSON-1893721304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-97252b92-2745-484f-a9e4-8b39152fcaf7 tempest-VolumesListAdminTestJSON-1893721304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:41 devstack sudo[102983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:50:41 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:41 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-13fb2f20-b31d-4254-931b-d2883ca58c2c tempest-VolumesListAdminTestJSON-1405208235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-74178a01-599a-45e6-bbbc-0602ab2cf359" returned: 0 in 0.899s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-13fb2f20-b31d-4254-931b-d2883ca58c2c tempest-VolumesListAdminTestJSON-1405208235 None] Lock "cinder-quobyte-74178a01-599a-45e6-bbbc-0602ab2cf359" released by "delete_volume" :: held 2.289s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:50:41 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-13fb2f20-b31d-4254-931b-d2883ca58c2c tempest-VolumesListAdminTestJSON-1405208235 None] Created reservations ['efccd9c8-24cc-49c7-8c01-6e91464378c9', 'bfcdcfb7-14dc-4efc-a2e0-3d1e26f67b6e', '1e766bb0-847d-4cbb-9e81-9e77c4bbb5c2', 'e627e4e7-cf3f-4c24-a15b-90164b68bf92'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:50:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-13fb2f20-b31d-4254-931b-d2883ca58c2c tempest-VolumesListAdminTestJSON-1405208235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-13fb2f20-b31d-4254-931b-d2883ca58c2c tempest-VolumesListAdminTestJSON-1405208235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-13fb2f20-b31d-4254-931b-d2883ca58c2c tempest-VolumesListAdminTestJSON-1405208235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:50:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-13fb2f20-b31d-4254-931b-d2883ca58c2c tempest-VolumesListAdminTestJSON-1405208235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:50:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-13fb2f20-b31d-4254-931b-d2883ca58c2c tempest-VolumesListAdminTestJSON-1405208235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-13fb2f20-b31d-4254-931b-d2883ca58c2c tempest-VolumesListAdminTestJSON-1405208235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:41 devstack sudo[102986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:50:41 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:41 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-22976589-b9d0-4fb9-9a1c-3c0bb2228aa4 req-73c6ad03-9f91-4f6f-9ca4-4030f37cd363 tempest-AttachVolumeTestJSON-1893104206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c6ec87da-844b-4085-bfe5-0edda573cf64" returned: 0 in 1.107s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-22976589-b9d0-4fb9-9a1c-3c0bb2228aa4 req-73c6ad03-9f91-4f6f-9ca4-4030f37cd363 tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.138s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-22976589-b9d0-4fb9-9a1c-3c0bb2228aa4 req-73c6ad03-9f91-4f6f-9ca4-4030f37cd363 tempest-AttachVolumeTestJSON-1893104206 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85', 'name': 'volume-c6ec87da-844b-4085-bfe5-0edda573cf64', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca9aacfa-f8f6-4b82-be90-2bfc7aaf189f', 'enforce_multipath': True} {{(pid=93708) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 05:50:41 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-97252b92-2745-484f-a9e4-8b39152fcaf7 tempest-VolumesListAdminTestJSON-1893721304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.875s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:41 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-97252b92-2745-484f-a9e4-8b39152fcaf7 tempest-VolumesListAdminTestJSON-1893721304 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:50:41 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-97252b92-2745-484f-a9e4-8b39152fcaf7 tempest-VolumesListAdminTestJSON-1893721304 None] Deleted volume successfully.
Jun 26 05:50:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-97252b92-2745-484f-a9e4-8b39152fcaf7 tempest-VolumesListAdminTestJSON-1893721304 None] Lock "cinder-9c229f48-8d35-4480-a4d2-5da47c339160-delete_volume" released by "delete_volume" :: held 3.262s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:50:42 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-22976589-b9d0-4fb9-9a1c-3c0bb2228aa4 req-73c6ad03-9f91-4f6f-9ca4-4030f37cd363 tempest-AttachVolumeTestJSON-1893104206 None] attachment_update completed successfully.
Jun 26 05:50:42 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-13fb2f20-b31d-4254-931b-d2883ca58c2c tempest-VolumesListAdminTestJSON-1405208235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.827s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:42 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-13fb2f20-b31d-4254-931b-d2883ca58c2c tempest-VolumesListAdminTestJSON-1405208235 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:50:42 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-13fb2f20-b31d-4254-931b-d2883ca58c2c tempest-VolumesListAdminTestJSON-1405208235 None] Deleted volume successfully.
Jun 26 05:50:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-13fb2f20-b31d-4254-931b-d2883ca58c2c tempest-VolumesListAdminTestJSON-1405208235 None] Lock "cinder-74178a01-599a-45e6-bbbc-0602ab2cf359-delete_volume" released by "delete_volume" :: held 3.423s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:50:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-98459a38-f007-487f-8639-350d601cb7cd tempest-VolumesListAdminTestJSON-1405208235 None] Acquiring lock "cinder-9c993c4c-18a6-4b79-bb89-d1e92a5900c2-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:50:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-98459a38-f007-487f-8639-350d601cb7cd tempest-VolumesListAdminTestJSON-1405208235 None] Lock "cinder-9c993c4c-18a6-4b79-bb89-d1e92a5900c2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:50:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-98459a38-f007-487f-8639-350d601cb7cd tempest-VolumesListAdminTestJSON-1405208235 None] Acquiring lock "cinder-quobyte-9c993c4c-18a6-4b79-bb89-d1e92a5900c2" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:50:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-98459a38-f007-487f-8639-350d601cb7cd tempest-VolumesListAdminTestJSON-1405208235 None] Lock "cinder-quobyte-9c993c4c-18a6-4b79-bb89-d1e92a5900c2" acquired by "delete_volume" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:50:42 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca987a28-e78f-460e-b67a-3234ce677b4b]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:50:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-98459a38-f007-487f-8639-350d601cb7cd tempest-VolumesListAdminTestJSON-1405208235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c993c4c-18a6-4b79-bb89-d1e92a5900c2 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:42 devstack sudo[103061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c993c4c-18a6-4b79-bb89-d1e92a5900c2
Jun 26 05:50:42 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:43 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-98459a38-f007-487f-8639-350d601cb7cd tempest-VolumesListAdminTestJSON-1405208235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c993c4c-18a6-4b79-bb89-d1e92a5900c2" returned: 0 in 0.896s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-98459a38-f007-487f-8639-350d601cb7cd tempest-VolumesListAdminTestJSON-1405208235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c993c4c-18a6-4b79-bb89-d1e92a5900c2 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:43 devstack sudo[103384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c993c4c-18a6-4b79-bb89-d1e92a5900c2
Jun 26 05:50:43 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:44 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-98459a38-f007-487f-8639-350d601cb7cd tempest-VolumesListAdminTestJSON-1405208235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9c993c4c-18a6-4b79-bb89-d1e92a5900c2" returned: 0 in 0.888s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-98459a38-f007-487f-8639-350d601cb7cd tempest-VolumesListAdminTestJSON-1405208235 None] Lock "cinder-quobyte-9c993c4c-18a6-4b79-bb89-d1e92a5900c2" released by "delete_volume" :: held 1.877s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:50:44 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-98459a38-f007-487f-8639-350d601cb7cd tempest-VolumesListAdminTestJSON-1405208235 None] Created reservations ['81a53490-c178-496a-b792-e04464ec594a', '96e5b167-43a6-4823-b751-15beb0914df4', 'f423c45f-6925-43a9-9a4a-095772d9d92b', 'e5ab7f72-408b-4793-a1c7-33a1f89b5bb2'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:50:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-77d58288-fc49-43fd-8687-b8297c28c196 req-d52a4641-5eca-476d-aba7-bc971e15337b tempest-TestInstancesWithCinderVolumes-1417758814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-77d58288-fc49-43fd-8687-b8297c28c196 req-d52a4641-5eca-476d-aba7-bc971e15337b tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-98459a38-f007-487f-8639-350d601cb7cd tempest-VolumesListAdminTestJSON-1405208235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-98459a38-f007-487f-8639-350d601cb7cd tempest-VolumesListAdminTestJSON-1405208235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-98459a38-f007-487f-8639-350d601cb7cd tempest-VolumesListAdminTestJSON-1405208235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:50:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-98459a38-f007-487f-8639-350d601cb7cd tempest-VolumesListAdminTestJSON-1405208235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:50:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-98459a38-f007-487f-8639-350d601cb7cd tempest-VolumesListAdminTestJSON-1405208235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-98459a38-f007-487f-8639-350d601cb7cd tempest-VolumesListAdminTestJSON-1405208235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:44 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[0917e937-750c-462e-89b6-03f88eafdf81]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:50:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-77d58288-fc49-43fd-8687-b8297c28c196 req-d52a4641-5eca-476d-aba7-bc971e15337b tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:44 devstack sudo[103397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:50:44 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:44 devstack sudo[103398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5
Jun 26 05:50:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-16c2d694-8d1a-4e98-b8ea-da70d9233a74 tempest-VolumesListAdminTestJSON-1405208235 None] Acquiring lock "cinder-2fd9c9ae-88b9-4b51-821b-b546f9a80d70-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:50:44 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-16c2d694-8d1a-4e98-b8ea-da70d9233a74 tempest-VolumesListAdminTestJSON-1405208235 None] Lock "cinder-2fd9c9ae-88b9-4b51-821b-b546f9a80d70-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:50:45 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-16c2d694-8d1a-4e98-b8ea-da70d9233a74 tempest-VolumesListAdminTestJSON-1405208235 None] Acquiring lock "cinder-quobyte-2fd9c9ae-88b9-4b51-821b-b546f9a80d70" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:50:45 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-16c2d694-8d1a-4e98-b8ea-da70d9233a74 tempest-VolumesListAdminTestJSON-1405208235 None] Lock "cinder-quobyte-2fd9c9ae-88b9-4b51-821b-b546f9a80d70" acquired by "delete_volume" :: waited 0.028s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:50:45 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c11b9f4-cc6e-4a2e-908a-b0bc73309a92]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:50:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-16c2d694-8d1a-4e98-b8ea-da70d9233a74 tempest-VolumesListAdminTestJSON-1405208235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2fd9c9ae-88b9-4b51-821b-b546f9a80d70 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:45 devstack sudo[103401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2fd9c9ae-88b9-4b51-821b-b546f9a80d70
Jun 26 05:50:45 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:45 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-98459a38-f007-487f-8639-350d601cb7cd tempest-VolumesListAdminTestJSON-1405208235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.927s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:45 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-98459a38-f007-487f-8639-350d601cb7cd tempest-VolumesListAdminTestJSON-1405208235 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:50:45 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-98459a38-f007-487f-8639-350d601cb7cd tempest-VolumesListAdminTestJSON-1405208235 None] Deleted volume successfully.
Jun 26 05:50:45 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-98459a38-f007-487f-8639-350d601cb7cd tempest-VolumesListAdminTestJSON-1405208235 None] Lock "cinder-9c993c4c-18a6-4b79-bb89-d1e92a5900c2-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:50:45 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-77d58288-fc49-43fd-8687-b8297c28c196 req-d52a4641-5eca-476d-aba7-bc971e15337b tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5" returned: 0 in 1.313s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-77d58288-fc49-43fd-8687-b8297c28c196 req-d52a4641-5eca-476d-aba7-bc971e15337b tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:46 devstack sudo[103407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5
Jun 26 05:50:46 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:46 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-16c2d694-8d1a-4e98-b8ea-da70d9233a74 tempest-VolumesListAdminTestJSON-1405208235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2fd9c9ae-88b9-4b51-821b-b546f9a80d70" returned: 0 in 1.141s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-16c2d694-8d1a-4e98-b8ea-da70d9233a74 tempest-VolumesListAdminTestJSON-1405208235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2fd9c9ae-88b9-4b51-821b-b546f9a80d70 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:46 devstack sudo[103412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2fd9c9ae-88b9-4b51-821b-b546f9a80d70
Jun 26 05:50:46 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:46 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-77d58288-fc49-43fd-8687-b8297c28c196 req-d52a4641-5eca-476d-aba7-bc971e15337b tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5" returned: 1 in 0.817s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-77d58288-fc49-43fd-8687-b8297c28c196 req-d52a4641-5eca-476d-aba7-bc971e15337b tempest-TestInstancesWithCinderVolumes-1417758814 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 05:50:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-77d58288-fc49-43fd-8687-b8297c28c196 req-d52a4641-5eca-476d-aba7-bc971e15337b tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.210s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-77d58288-fc49-43fd-8687-b8297c28c196 req-d52a4641-5eca-476d-aba7-bc971e15337b tempest-TestInstancesWithCinderVolumes-1417758814 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85', 'name': 'volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e470afb4-f83a-42cb-aa92-938acee1835a', 'enforce_multipath': True} {{(pid=93708) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 05:50:46 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-77d58288-fc49-43fd-8687-b8297c28c196 req-d52a4641-5eca-476d-aba7-bc971e15337b tempest-TestInstancesWithCinderVolumes-1417758814 None] attachment_update completed successfully.
Jun 26 05:50:47 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-16c2d694-8d1a-4e98-b8ea-da70d9233a74 tempest-VolumesListAdminTestJSON-1405208235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2fd9c9ae-88b9-4b51-821b-b546f9a80d70" returned: 0 in 0.808s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-16c2d694-8d1a-4e98-b8ea-da70d9233a74 tempest-VolumesListAdminTestJSON-1405208235 None] Lock "cinder-quobyte-2fd9c9ae-88b9-4b51-821b-b546f9a80d70" released by "delete_volume" :: held 2.013s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:50:47 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-16c2d694-8d1a-4e98-b8ea-da70d9233a74 tempest-VolumesListAdminTestJSON-1405208235 None] Created reservations ['c197e007-3021-4728-bc4f-dd38267753df', '6300b7a0-924d-4a1f-9e1b-7416c03b7bfa', '6addb6aa-b1c4-49ba-bbc5-514642fcc6f3', 'd8d1f0df-eb9a-47b4-b14e-01820f41c658'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:50:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-16c2d694-8d1a-4e98-b8ea-da70d9233a74 tempest-VolumesListAdminTestJSON-1405208235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-16c2d694-8d1a-4e98-b8ea-da70d9233a74 tempest-VolumesListAdminTestJSON-1405208235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:47 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-16c2d694-8d1a-4e98-b8ea-da70d9233a74 tempest-VolumesListAdminTestJSON-1405208235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:50:47 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-16c2d694-8d1a-4e98-b8ea-da70d9233a74 tempest-VolumesListAdminTestJSON-1405208235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:50:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-16c2d694-8d1a-4e98-b8ea-da70d9233a74 tempest-VolumesListAdminTestJSON-1405208235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-16c2d694-8d1a-4e98-b8ea-da70d9233a74 tempest-VolumesListAdminTestJSON-1405208235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:47 devstack sudo[103418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:50:47 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:47 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:50:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Flow 'volume_create_manager' (e17b768d-accc-4d54-a958-188b8b806beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:50:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50920d71-d885-47b9-98db-78bd30fbee4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50920d71-d885-47b9-98db-78bd30fbee4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1355862293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f31d85-a93a-4815-ab7a-3f49b239abb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad43f02466524bf1a0cbd95bc7de35b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:50:48Z,use_quota=True,user_id='8e5cac8a1d734889b9ba485b7d88a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d8e699-dd7a-4748-b475-f7d7cfb27f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d8e699-dd7a-4748-b475-f7d7cfb27f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5745c855-edd1-4054-9082-05ead256a26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5745c855-edd1-4054-9082-05ead256a26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8f31d85-a93a-4815-ab7a-3f49b239abb8', 'volume_name': 'volume-a8f31d85-a93a-4815-ab7a-3f49b239abb8', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05daec75-ae98-456b-980c-bd65fc3e2b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05daec75-ae98-456b-980c-bd65fc3e2b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43529aa4-dd97-44c7-967b-bbc5ec41d11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:48 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Volume a8f31d85-a93a-4815-ab7a-3f49b239abb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8f31d85-a93a-4815-ab7a-3f49b239abb8', 'volume_size': 1}
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1355862293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f31d85-a93a-4815-ab7a-3f49b239abb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad43f02466524bf1a0cbd95bc7de35b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:50:48Z,use_quota=True,user_id='8e5cac8a1d734889b9ba485b7d88a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Creating volume a8f31d85-a93a-4815-ab7a-3f49b239abb8 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:50:48 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8f31d85-a93a-4815-ab7a-3f49b239abb8 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:48 devstack sudo[103421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8f31d85-a93a-4815-ab7a-3f49b239abb8 1073741824
Jun 26 05:50:48 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:48 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-16c2d694-8d1a-4e98-b8ea-da70d9233a74 tempest-VolumesListAdminTestJSON-1405208235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.860s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-16c2d694-8d1a-4e98-b8ea-da70d9233a74 tempest-VolumesListAdminTestJSON-1405208235 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:50:48 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-16c2d694-8d1a-4e98-b8ea-da70d9233a74 tempest-VolumesListAdminTestJSON-1405208235 None] Deleted volume successfully.
Jun 26 05:50:48 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-16c2d694-8d1a-4e98-b8ea-da70d9233a74 tempest-VolumesListAdminTestJSON-1405208235 None] Lock "cinder-2fd9c9ae-88b9-4b51-821b-b546f9a80d70-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:50:49 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8f31d85-a93a-4815-ab7a-3f49b239abb8 1073741824" returned: 0 in 1.017s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8f31d85-a93a-4815-ab7a-3f49b239abb8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:49 devstack sudo[103427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8f31d85-a93a-4815-ab7a-3f49b239abb8
Jun 26 05:50:49 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:49 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8f31d85-a93a-4815-ab7a-3f49b239abb8" returned: 0 in 0.786s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:49 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:50:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:49 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43529aa4-dd97-44c7-967b-bbc5ec41d11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8f31d85-a93a-4815-ab7a-3f49b239abb8', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56dbc79-eefa-4087-bc54-24ce5a3a3b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:50 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Volume volume-a8f31d85-a93a-4815-ab7a-3f49b239abb8 (a8f31d85-a93a-4815-ab7a-3f49b239abb8): created successfully
Jun 26 05:50:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56dbc79-eefa-4087-bc54-24ce5a3a3b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Flow 'volume_create_manager' (e17b768d-accc-4d54-a958-188b8b806beb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:50:50 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-424987eb-b5d1-4967-afb1-5aacb0ca1197 tempest-AttachVolumeTestJSON-1893104206 None] Created volume successfully.
Jun 26 05:50:53 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:50:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Flow 'volume_create_manager' (07fad760-d884-4726-9177-6f72f03e4a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:50:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949d18cc-7825-46be-bc00-27310da047e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949d18cc-7825-46be-bc00-27310da047e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1182159422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=013f99f9-2f9b-41ca-9dd2-0d4423d0a9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d192686f7eb4609bfb636d1670a00bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:50:54Z,use_quota=True,user_id='8b1a53a365d741e4ac84484d9cb7cb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1961bdb5-f6d2-45a6-bf9e-61d2dd9ff922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1961bdb5-f6d2-45a6-bf9e-61d2dd9ff922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d373cf43-7f32-4bef-beba-211b37cf3d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d373cf43-7f32-4bef-beba-211b37cf3d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '013f99f9-2f9b-41ca-9dd2-0d4423d0a9da', 'volume_name': 'volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65788ab9-3e75-4b2f-81e1-f25b08c87f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65788ab9-3e75-4b2f-81e1-f25b08c87f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978ac42a-f328-45c3-8d30-f250e00128d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:54 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Volume 013f99f9-2f9b-41ca-9dd2-0d4423d0a9da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da', 'volume_size': 1}
Jun 26 05:50:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1182159422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=013f99f9-2f9b-41ca-9dd2-0d4423d0a9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d192686f7eb4609bfb636d1670a00bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:50:54Z,use_quota=True,user_id='8b1a53a365d741e4ac84484d9cb7cb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:50:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Creating volume 013f99f9-2f9b-41ca-9dd2-0d4423d0a9da {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:50:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:50:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:50:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:50:54 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:50:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:54 devstack sudo[103521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da 1073741824
Jun 26 05:50:54 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-08eb94a4-7940-4355-b9f1-ad59f38ed6be req-f6fa2b3e-d129-4ec6-85a1-f41f4c4dc52d tempest-AttachVolumeTestJSON-1893104206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:55 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da 1073741824" returned: 0 in 1.069s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:55 devstack sudo[103537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da
Jun 26 05:50:55 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:55 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da" returned: 0 in 0.856s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:55 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:50:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-08eb94a4-7940-4355-b9f1-ad59f38ed6be req-f6fa2b3e-d129-4ec6-85a1-f41f4c4dc52d tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.117s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978ac42a-f328-45c3-8d30-f250e00128d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d36dce-ad87-4875-82af-e037a07e2045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:50:56 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c57d5e-3992-4301-a49d-78f4f711dabf]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:50:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-08eb94a4-7940-4355-b9f1-ad59f38ed6be req-f6fa2b3e-d129-4ec6-85a1-f41f4c4dc52d tempest-AttachVolumeTestJSON-1893104206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8f31d85-a93a-4815-ab7a-3f49b239abb8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:56 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Volume volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da (013f99f9-2f9b-41ca-9dd2-0d4423d0a9da): created successfully
Jun 26 05:50:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d36dce-ad87-4875-82af-e037a07e2045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:50:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Flow 'volume_create_manager' (07fad760-d884-4726-9177-6f72f03e4a56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:50:56 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-7cf96120-f753-4c9e-a137-27d0686d65e5 tempest-SnapshotMetadataTestJSON-915485355 None] Created volume successfully.
Jun 26 05:50:56 devstack sudo[103540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8f31d85-a93a-4815-ab7a-3f49b239abb8
Jun 26 05:50:56 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:57 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-08eb94a4-7940-4355-b9f1-ad59f38ed6be req-f6fa2b3e-d129-4ec6-85a1-f41f4c4dc52d tempest-AttachVolumeTestJSON-1893104206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8f31d85-a93a-4815-ab7a-3f49b239abb8" returned: 0 in 1.161s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-08eb94a4-7940-4355-b9f1-ad59f38ed6be req-f6fa2b3e-d129-4ec6-85a1-f41f4c4dc52d tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.196s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:50:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-08eb94a4-7940-4355-b9f1-ad59f38ed6be req-f6fa2b3e-d129-4ec6-85a1-f41f4c4dc52d tempest-AttachVolumeTestJSON-1893104206 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85', 'name': 'volume-a8f31d85-a93a-4815-ab7a-3f49b239abb8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '325b5bba-88d6-41cc-968f-bdcd726b2678', 'enforce_multipath': True} {{(pid=93708) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 05:50:57 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-08eb94a4-7940-4355-b9f1-ad59f38ed6be req-f6fa2b3e-d129-4ec6-85a1-f41f4c4dc52d tempest-AttachVolumeTestJSON-1893104206 None] attachment_update completed successfully.
Jun 26 05:50:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2a9c04d3-a6bc-446e-a16e-e2ecede13efe tempest-SnapshotMetadataTestJSON-915485355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:50:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2a9c04d3-a6bc-446e-a16e-e2ecede13efe tempest-SnapshotMetadataTestJSON-915485355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:50:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-2a9c04d3-a6bc-446e-a16e-e2ecede13efe tempest-SnapshotMetadataTestJSON-915485355 None] Creating offline snapshot 8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e of volume 013f99f9-2f9b-41ca-9dd2-0d4423d0a9da {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:50:57 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[aece40f0-b912-4c7a-aa17-e6fa30964014]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:50:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2a9c04d3-a6bc-446e-a16e-e2ecede13efe tempest-SnapshotMetadataTestJSON-915485355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:57 devstack sudo[103546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da
Jun 26 05:50:57 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:50:59 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root
Jun 26 05:50:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2a9c04d3-a6bc-446e-a16e-e2ecede13efe tempest-SnapshotMetadataTestJSON-915485355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da" returned: 0 in 1.866s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:50:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2a9c04d3-a6bc-446e-a16e-e2ecede13efe tempest-SnapshotMetadataTestJSON-915485355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:50:59 devstack sudo[103579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e 1G
Jun 26 05:50:59 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:00 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2a9c04d3-a6bc-446e-a16e-e2ecede13efe tempest-SnapshotMetadataTestJSON-915485355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e 1G" returned: 0 in 1.335s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2a9c04d3-a6bc-446e-a16e-e2ecede13efe tempest-SnapshotMetadataTestJSON-915485355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:00 devstack sudo[103595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e
Jun 26 05:51:00 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:01 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2a9c04d3-a6bc-446e-a16e-e2ecede13efe tempest-SnapshotMetadataTestJSON-915485355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e" returned: 0 in 0.981s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:01 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-2a9c04d3-a6bc-446e-a16e-e2ecede13efe tempest-SnapshotMetadataTestJSON-915485355 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e is being set with open permissions: ugo+rw
Jun 26 05:51:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2a9c04d3-a6bc-446e-a16e-e2ecede13efe tempest-SnapshotMetadataTestJSON-915485355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:01 devstack sudo[103603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e
Jun 26 05:51:01 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:03 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2a9c04d3-a6bc-446e-a16e-e2ecede13efe tempest-SnapshotMetadataTestJSON-915485355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e" returned: 0 in 1.462s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2a9c04d3-a6bc-446e-a16e-e2ecede13efe tempest-SnapshotMetadataTestJSON-915485355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:03 devstack sudo[103636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.info
Jun 26 05:51:03 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:04 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2a9c04d3-a6bc-446e-a16e-e2ecede13efe tempest-SnapshotMetadataTestJSON-915485355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.info" returned: 0 in 0.957s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:04 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-2a9c04d3-a6bc-446e-a16e-e2ecede13efe tempest-SnapshotMetadataTestJSON-915485355 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.info is being set with open permissions: ugo+rw
Jun 26 05:51:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2a9c04d3-a6bc-446e-a16e-e2ecede13efe tempest-SnapshotMetadataTestJSON-915485355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:04 devstack sudo[103641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.info
Jun 26 05:51:04 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:05 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2a9c04d3-a6bc-446e-a16e-e2ecede13efe tempest-SnapshotMetadataTestJSON-915485355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.info" returned: 0 in 0.997s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2a9c04d3-a6bc-446e-a16e-e2ecede13efe tempest-SnapshotMetadataTestJSON-915485355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.805s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:05 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-e71b739f-ccfe-4d87-b231-db958b90bee4 req-6b0f4738-888f-4798-ad95-73de62e1b278 tempest-AttachVolumeTestJSON-1893104206 None] Terminate volume connection completed successfully.
Jun 26 05:51:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-e71b739f-ccfe-4d87-b231-db958b90bee4 req-6b0f4738-888f-4798-ad95-73de62e1b278 tempest-AttachVolumeTestJSON-1893104206 None] Deleting attachment ca9aacfa-f8f6-4b82-be90-2bfc7aaf189f. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 05:51:05 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-2a9c04d3-a6bc-446e-a16e-e2ecede13efe tempest-SnapshotMetadataTestJSON-915485355 None] Create snapshot completed successfully
Jun 26 05:51:08 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] Acquiring lock "cinder-8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:08 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] Lock "cinder-8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:08 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] Acquiring lock "cinder-quobyte-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:08 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] Lock "cinder-quobyte-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:08 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] Acquiring lock "cinder-quobyte-8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:08 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] Lock "cinder-quobyte-8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:08 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] Deleting offline snapshot 8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e of volume 013f99f9-2f9b-41ca-9dd2-0d4423d0a9da {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:51:08 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] snapshot_file for this snap is: volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:51:08 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2f60a6-5cc2-4cbb-9773-69b25d8844f6]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:51:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:08 devstack sudo[103734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e
Jun 26 05:51:08 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:09 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e" returned: 0 in 1.292s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:51:09 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea78563a-dc79-4643-9939-e1e2d5ac2442]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:51:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:09 devstack sudo[103744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da
Jun 26 05:51:09 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:10 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da" returned: 0 in 1.033s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:10 devstack sudo[103822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e
Jun 26 05:51:10 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:51:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:10 devstack sudo[103824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:51:10 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:10 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-ebc77f6d-ef68-46a7-af52-a309b6f4907a req-3b6a92ea-0b08-4547-b727-c0a18146d6ea tempest-AttachVolumeTestJSON-1893104206 None] Terminate volume connection completed successfully.
Jun 26 05:51:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-ebc77f6d-ef68-46a7-af52-a309b6f4907a req-3b6a92ea-0b08-4547-b727-c0a18146d6ea tempest-AttachVolumeTestJSON-1893104206 None] Deleting attachment 325b5bba-88d6-41cc-968f-bdcd726b2678. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Flow 'volume_create_manager' (ed5812e6-59ae-49f3-ac3a-f2ed7c7cd76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d56c82-c84a-4b54-8b52-cea706250ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d56c82-c84a-4b54-8b52-cea706250ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-856917115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8022db78-2685-46b8-af62-a578797f01fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1d1466f1d94f7e91947be8ada55971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:51:11Z,use_quota=True,user_id='5f41366cccb84013b42c944c6d4cc19d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3197af-a36f-4265-8625-67a3e96b96ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3197af-a36f-4265-8625-67a3e96b96ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ab1d2c-66c3-401b-b5b3-477976eb9f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ab1d2c-66c3-401b-b5b3-477976eb9f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8022db78-2685-46b8-af62-a578797f01fe', 'volume_name': 'volume-8022db78-2685-46b8-af62-a578797f01fe', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2233d7d9-2b4d-4f2e-97a4-95fc229d5781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2233d7d9-2b4d-4f2e-97a4-95fc229d5781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77420393-4fc4-49c4-ae02-d1fe3dd6ed37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:11 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Volume 8022db78-2685-46b8-af62-a578797f01fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8022db78-2685-46b8-af62-a578797f01fe', 'volume_size': 1}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-856917115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8022db78-2685-46b8-af62-a578797f01fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1d1466f1d94f7e91947be8ada55971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:51:11Z,use_quota=True,user_id='5f41366cccb84013b42c944c6d4cc19d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Creating volume 8022db78-2685-46b8-af62-a578797f01fe {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:51:11 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8022db78-2685-46b8-af62-a578797f01fe 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:11 devstack sudo[103826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8022db78-2685-46b8-af62-a578797f01fe 1073741824
Jun 26 05:51:11 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:11 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:11 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e" returned: 0 in 1.362s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.267s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:11 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:51:12 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:51:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 28 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:51:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>, <Thread(tpool_thread_0, started daemon 124035494721216)>, <Thread(tpool_thread_1, started daemon 124035486328512)>, <Thread(tpool_thread_2, started daemon 124035477919424)>, <Thread(tpool_thread_3, started daemon 124035469510336)>, <Thread(tpool_thread_4, started daemon 124035461101248)>, <Thread(tpool_thread_5, started daemon 124035452692160)>, <Thread(tpool_thread_6, started daemon 124035444283072)>, <Thread(tpool_thread_7, started daemon 124035435873984)>, <Thread(tpool_thread_8, started daemon 124035427464896)>, <Thread(tpool_thread_9, started daemon 124035419055808)>, <Thread(tpool_thread_10, started daemon 124035410646720)>, <Thread(tpool_thread_11, started daemon 124035402237632)>, <Thread(tpool_thread_12, started daemon 124035393828544)>, <Thread(tpool_thread_13, started daemon 124035385419456)>, <Thread(tpool_thread_14, started daemon 124035377010368)>, <Thread(tpool_thread_15, started daemon 124035368601280)>, <Thread(tpool_thread_16, started daemon 124035360192192)>, <Thread(tpool_thread_17, started daemon 124035351783104)>, <Thread(tpool_thread_18, started daemon 124035343374016)>, <Thread(tpool_thread_19, started daemon 124035334964928)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:51:12 devstack sudo[103833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e
Jun 26 05:51:12 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:12 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8022db78-2685-46b8-af62-a578797f01fe 1073741824" returned: 0 in 1.158s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8022db78-2685-46b8-af62-a578797f01fe {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:12 devstack sudo[103839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8022db78-2685-46b8-af62-a578797f01fe
Jun 26 05:51:12 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:12 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da.8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e" returned: 0 in 0.865s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:12 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] Lock "cinder-quobyte-8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e" released by "_delete_snapshot" :: held 4.712s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:12 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] Lock "cinder-quobyte-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da" released by "delete_snapshot" :: held 4.749s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:12 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] Created reservations ['62ae8751-1ea4-458b-9009-c021d207a9fb', '546963e0-d41c-4762-9277-0e88684187f7', '41ac4cd7-32d3-4902-b2da-76eccb91b378', '6e5c3067-0d6e-4015-b54c-fc9bba5bbbcb'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:51:13 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] Delete snapshot completed successfully.
Jun 26 05:51:13 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4cbbcec9-c375-4bc0-a33b-0917a9bc1643 tempest-SnapshotMetadataTestJSON-915485355 None] Lock "cinder-8a735d47-beaf-42ef-bfae-0bb3d3a0bc0e-delete_snapshot" released by "delete_snapshot" :: held 4.978s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:13 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8022db78-2685-46b8-af62-a578797f01fe" returned: 0 in 0.780s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:13 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:51:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:13 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77420393-4fc4-49c4-ae02-d1fe3dd6ed37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8022db78-2685-46b8-af62-a578797f01fe', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:13 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4294798f-c0e3-4349-a5ff-f4b958b7e566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:13 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Volume volume-8022db78-2685-46b8-af62-a578797f01fe (8022db78-2685-46b8-af62-a578797f01fe): created successfully
Jun 26 05:51:13 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4294798f-c0e3-4349-a5ff-f4b958b7e566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:13 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Flow 'volume_create_manager' (ed5812e6-59ae-49f3-ac3a-f2ed7c7cd76c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:51:13 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-acb1a6e8-44b3-4191-b0ba-e6ed52d31bf4 tempest-VolumesActionsTest-1876783963 None] Created volume successfully.
Jun 26 05:51:13 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7405708f-1e60-4c82-8e6c-83ca50c2e6e9 tempest-SnapshotMetadataTestJSON-915485355 None] Acquiring lock "cinder-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:13 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7405708f-1e60-4c82-8e6c-83ca50c2e6e9 tempest-SnapshotMetadataTestJSON-915485355 None] Lock "cinder-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:13 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7405708f-1e60-4c82-8e6c-83ca50c2e6e9 tempest-SnapshotMetadataTestJSON-915485355 None] Acquiring lock "cinder-quobyte-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:13 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7405708f-1e60-4c82-8e6c-83ca50c2e6e9 tempest-SnapshotMetadataTestJSON-915485355 None] Lock "cinder-quobyte-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da" acquired by "delete_volume" :: waited 0.021s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:13 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[a090c1cc-1a5f-4847-b394-0edbdbc7bfee]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:51:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7405708f-1e60-4c82-8e6c-83ca50c2e6e9 tempest-SnapshotMetadataTestJSON-915485355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:13 devstack sudo[103844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da
Jun 26 05:51:13 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dd65ea94-075b-4ba5-9cdd-5b03403eb549 tempest-VolumesActionsTest-1876783963 None] Acquiring lock "cinder-8022db78-2685-46b8-af62-a578797f01fe" by "attach_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dd65ea94-075b-4ba5-9cdd-5b03403eb549 tempest-VolumesActionsTest-1876783963 None] Lock "cinder-8022db78-2685-46b8-af62-a578797f01fe" acquired by "attach_volume" :: waited 0.041s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:14 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-dd65ea94-075b-4ba5-9cdd-5b03403eb549 tempest-VolumesActionsTest-1876783963 None] Attaching volume 8022db78-2685-46b8-af62-a578797f01fe to instance bceebb7d-871a-43bc-9b96-a9fe3f4d9a04 at mountpoint /dev/vdb on host None.
Jun 26 05:51:14 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-dd65ea94-075b-4ba5-9cdd-5b03403eb549 tempest-VolumesActionsTest-1876783963 None] Attach volume completed successfully.
Jun 26 05:51:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dd65ea94-075b-4ba5-9cdd-5b03403eb549 tempest-VolumesActionsTest-1876783963 None] Lock "cinder-8022db78-2685-46b8-af62-a578797f01fe" released by "attach_volume" :: held 0.254s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:14 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7405708f-1e60-4c82-8e6c-83ca50c2e6e9 tempest-SnapshotMetadataTestJSON-915485355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da" returned: 0 in 1.212s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7405708f-1e60-4c82-8e6c-83ca50c2e6e9 tempest-SnapshotMetadataTestJSON-915485355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:14 devstack sudo[103885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da
Jun 26 05:51:14 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:15 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-47d11ba6-331e-4463-a4cf-7e78b29217a3 tempest-VolumesActionsTest-450281722 None] Terminate volume connection completed successfully.
Jun 26 05:51:15 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7405708f-1e60-4c82-8e6c-83ca50c2e6e9 tempest-SnapshotMetadataTestJSON-915485355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da" returned: 0 in 0.798s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:15 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7405708f-1e60-4c82-8e6c-83ca50c2e6e9 tempest-SnapshotMetadataTestJSON-915485355 None] Lock "cinder-quobyte-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da" released by "delete_volume" :: held 2.068s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:15 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=86,cinder:SELECT=73,cinder:INSERT=21,cinder:DELETE=10 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:51:15 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-7405708f-1e60-4c82-8e6c-83ca50c2e6e9 tempest-SnapshotMetadataTestJSON-915485355 None] Created reservations ['386b7af4-3ade-419a-b4b3-ac753f18ce29', 'f9419400-21cb-4688-ba62-c7ae65e0e064', '30a5dac3-2312-4ee2-a550-4c6768236972', '634243a5-a7ee-40a2-9933-89c568168c9d'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:51:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7405708f-1e60-4c82-8e6c-83ca50c2e6e9 tempest-SnapshotMetadataTestJSON-915485355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7405708f-1e60-4c82-8e6c-83ca50c2e6e9 tempest-SnapshotMetadataTestJSON-915485355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7405708f-1e60-4c82-8e6c-83ca50c2e6e9 tempest-SnapshotMetadataTestJSON-915485355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7405708f-1e60-4c82-8e6c-83ca50c2e6e9 tempest-SnapshotMetadataTestJSON-915485355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7405708f-1e60-4c82-8e6c-83ca50c2e6e9 tempest-SnapshotMetadataTestJSON-915485355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7405708f-1e60-4c82-8e6c-83ca50c2e6e9 tempest-SnapshotMetadataTestJSON-915485355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:15 devstack sudo[103890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:51:15 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-47d11ba6-331e-4463-a4cf-7e78b29217a3 tempest-VolumesActionsTest-450281722 None] Acquiring lock "cinder-8022db78-2685-46b8-af62-a578797f01fe-detach_volume" by "detach_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-47d11ba6-331e-4463-a4cf-7e78b29217a3 tempest-VolumesActionsTest-450281722 None] Lock "cinder-8022db78-2685-46b8-af62-a578797f01fe-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:16 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-47d11ba6-331e-4463-a4cf-7e78b29217a3 tempest-VolumesActionsTest-450281722 None] Detaching volume 8022db78-2685-46b8-af62-a578797f01fe from instance bceebb7d-871a-43bc-9b96-a9fe3f4d9a04.
Jun 26 05:51:16 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-47d11ba6-331e-4463-a4cf-7e78b29217a3 tempest-VolumesActionsTest-450281722 None] Detach volume completed successfully.
Jun 26 05:51:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-47d11ba6-331e-4463-a4cf-7e78b29217a3 tempest-VolumesActionsTest-450281722 None] Lock "cinder-8022db78-2685-46b8-af62-a578797f01fe-detach_volume" released by "detach_volume" :: held 0.145s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:16 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7405708f-1e60-4c82-8e6c-83ca50c2e6e9 tempest-SnapshotMetadataTestJSON-915485355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.925s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:16 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-7405708f-1e60-4c82-8e6c-83ca50c2e6e9 tempest-SnapshotMetadataTestJSON-915485355 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:51:16 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-7405708f-1e60-4c82-8e6c-83ca50c2e6e9 tempest-SnapshotMetadataTestJSON-915485355 None] Deleted volume successfully.
Jun 26 05:51:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7405708f-1e60-4c82-8e6c-83ca50c2e6e9 tempest-SnapshotMetadataTestJSON-915485355 None] Lock "cinder-013f99f9-2f9b-41ca-9dd2-0d4423d0a9da-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d09962ab-b8b9-435a-a047-64d5ddeb8c8c tempest-VolumesActionsTest-1876783963 None] Acquiring lock "cinder-8022db78-2685-46b8-af62-a578797f01fe-detach_volume" by "detach_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d09962ab-b8b9-435a-a047-64d5ddeb8c8c tempest-VolumesActionsTest-1876783963 None] Lock "cinder-8022db78-2685-46b8-af62-a578797f01fe-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:16 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-d09962ab-b8b9-435a-a047-64d5ddeb8c8c tempest-VolumesActionsTest-1876783963 None] Volume detach called, but volume not attached.
Jun 26 05:51:16 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=100,cinder:UPDATE=86,cinder:DELETE=6,cinder:INSERT=25 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:51:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d09962ab-b8b9-435a-a047-64d5ddeb8c8c tempest-VolumesActionsTest-1876783963 None] Lock "cinder-8022db78-2685-46b8-af62-a578797f01fe-detach_volume" released by "detach_volume" :: held 0.061s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-20164930-f792-49b5-9d1f-72e4b9a07341 tempest-VolumesActionsTest-1876783963 None] Acquiring lock "cinder-8022db78-2685-46b8-af62-a578797f01fe-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-20164930-f792-49b5-9d1f-72e4b9a07341 tempest-VolumesActionsTest-1876783963 None] Lock "cinder-8022db78-2685-46b8-af62-a578797f01fe-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-20164930-f792-49b5-9d1f-72e4b9a07341 tempest-VolumesActionsTest-1876783963 None] Acquiring lock "cinder-quobyte-8022db78-2685-46b8-af62-a578797f01fe" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-20164930-f792-49b5-9d1f-72e4b9a07341 tempest-VolumesActionsTest-1876783963 None] Lock "cinder-quobyte-8022db78-2685-46b8-af62-a578797f01fe" acquired by "delete_volume" :: waited 0.036s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:17 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff3e1c2-3639-4710-a4e5-f193698af879]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:51:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-20164930-f792-49b5-9d1f-72e4b9a07341 tempest-VolumesActionsTest-1876783963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8022db78-2685-46b8-af62-a578797f01fe {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:18 devstack sudo[103895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8022db78-2685-46b8-af62-a578797f01fe
Jun 26 05:51:18 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:19 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-20164930-f792-49b5-9d1f-72e4b9a07341 tempest-VolumesActionsTest-1876783963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8022db78-2685-46b8-af62-a578797f01fe" returned: 0 in 1.170s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-20164930-f792-49b5-9d1f-72e4b9a07341 tempest-VolumesActionsTest-1876783963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8022db78-2685-46b8-af62-a578797f01fe {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:19 devstack sudo[103900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8022db78-2685-46b8-af62-a578797f01fe
Jun 26 05:51:19 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:20 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-20164930-f792-49b5-9d1f-72e4b9a07341 tempest-VolumesActionsTest-1876783963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8022db78-2685-46b8-af62-a578797f01fe" returned: 0 in 0.986s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:20 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-20164930-f792-49b5-9d1f-72e4b9a07341 tempest-VolumesActionsTest-1876783963 None] Lock "cinder-quobyte-8022db78-2685-46b8-af62-a578797f01fe" released by "delete_volume" :: held 2.228s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:20 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-20164930-f792-49b5-9d1f-72e4b9a07341 tempest-VolumesActionsTest-1876783963 None] Created reservations ['e61b3c98-9ad0-445a-a473-5b49252ebb3d', '67ea6f29-0ba8-4499-9394-c1c936e9e0c7', '24cef354-b23a-47c4-ae89-be8f5442f8a1', '841339e3-9cf0-4a59-ad61-a949793d10d9'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:51:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-20164930-f792-49b5-9d1f-72e4b9a07341 tempest-VolumesActionsTest-1876783963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-20164930-f792-49b5-9d1f-72e4b9a07341 tempest-VolumesActionsTest-1876783963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:20 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-20164930-f792-49b5-9d1f-72e4b9a07341 tempest-VolumesActionsTest-1876783963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:20 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-20164930-f792-49b5-9d1f-72e4b9a07341 tempest-VolumesActionsTest-1876783963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-20164930-f792-49b5-9d1f-72e4b9a07341 tempest-VolumesActionsTest-1876783963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-20164930-f792-49b5-9d1f-72e4b9a07341 tempest-VolumesActionsTest-1876783963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:20 devstack sudo[103906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:51:20 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:21 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-20164930-f792-49b5-9d1f-72e4b9a07341 tempest-VolumesActionsTest-1876783963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.978s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-20164930-f792-49b5-9d1f-72e4b9a07341 tempest-VolumesActionsTest-1876783963 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:51:21 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-20164930-f792-49b5-9d1f-72e4b9a07341 tempest-VolumesActionsTest-1876783963 None] Deleted volume successfully.
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-20164930-f792-49b5-9d1f-72e4b9a07341 tempest-VolumesActionsTest-1876783963 None] Lock "cinder-8022db78-2685-46b8-af62-a578797f01fe-delete_volume" released by "delete_volume" :: held 3.592s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Flow 'volume_create_manager' (274f1dba-c185-41f1-acf0-cf17f271f8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f82bdf3-373e-4608-88fe-c52f26b90af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f82bdf3-373e-4608-88fe-c52f26b90af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-453417362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd438d1b-1463-4e22-aecb-472080b48779,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b37f94a9bc2341fe92bbdfa19e1b5ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:51:22Z,use_quota=True,user_id='cde5459f48cc4f5e86c0227da3923c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2612848-8cb3-4702-bf32-355ba33c9f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2612848-8cb3-4702-bf32-355ba33c9f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739dcbee-257b-4ce4-8ca1-1c481cbfd4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739dcbee-257b-4ce4-8ca1-1c481cbfd4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd438d1b-1463-4e22-aecb-472080b48779', 'volume_name': 'volume-cd438d1b-1463-4e22-aecb-472080b48779', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcba94e4-8256-4673-a0c7-b61793cb19cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcba94e4-8256-4673-a0c7-b61793cb19cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7474ea-c1a9-4872-98f6-f68d49a3f9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:21 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Volume cd438d1b-1463-4e22-aecb-472080b48779: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd438d1b-1463-4e22-aecb-472080b48779', 'volume_size': 1}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-453417362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd438d1b-1463-4e22-aecb-472080b48779,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b37f94a9bc2341fe92bbdfa19e1b5ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:51:22Z,use_quota=True,user_id='cde5459f48cc4f5e86c0227da3923c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Creating volume cd438d1b-1463-4e22-aecb-472080b48779 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:51:21 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:51:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-cd438d1b-1463-4e22-aecb-472080b48779 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:21 devstack sudo[103941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-cd438d1b-1463-4e22-aecb-472080b48779 1073741824
Jun 26 05:51:21 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:22 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-49f47b52-43d6-452d-9c69-714854777ff1 tempest-AttachVolumeTestJSON-1893104206 None] Acquiring lock "cinder-a8f31d85-a93a-4815-ab7a-3f49b239abb8-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:22 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-49f47b52-43d6-452d-9c69-714854777ff1 tempest-AttachVolumeTestJSON-1893104206 None] Lock "cinder-a8f31d85-a93a-4815-ab7a-3f49b239abb8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:23 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-cd438d1b-1463-4e22-aecb-472080b48779 1073741824" returned: 0 in 1.247s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:23 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-49f47b52-43d6-452d-9c69-714854777ff1 tempest-AttachVolumeTestJSON-1893104206 None] Acquiring lock "cinder-quobyte-a8f31d85-a93a-4815-ab7a-3f49b239abb8" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-cd438d1b-1463-4e22-aecb-472080b48779 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:23 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-49f47b52-43d6-452d-9c69-714854777ff1 tempest-AttachVolumeTestJSON-1893104206 None] Lock "cinder-quobyte-a8f31d85-a93a-4815-ab7a-3f49b239abb8" acquired by "delete_volume" :: waited 0.043s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:23 devstack sudo[103989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-cd438d1b-1463-4e22-aecb-472080b48779
Jun 26 05:51:23 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:23 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4b1da3-0884-44bc-a69d-95bfca9855b3]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:51:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-49f47b52-43d6-452d-9c69-714854777ff1 tempest-AttachVolumeTestJSON-1893104206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8f31d85-a93a-4815-ab7a-3f49b239abb8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:23 devstack sudo[103991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8f31d85-a93a-4815-ab7a-3f49b239abb8
Jun 26 05:51:23 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:23 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-cd438d1b-1463-4e22-aecb-472080b48779" returned: 0 in 0.766s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:23 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] <== create_volume: return (2073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:51:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7474ea-c1a9-4872-98f6-f68d49a3f9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd438d1b-1463-4e22-aecb-472080b48779', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb522cd-4ed7-49cc-96b3-89e19877be46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:23 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Volume volume-cd438d1b-1463-4e22-aecb-472080b48779 (cd438d1b-1463-4e22-aecb-472080b48779): created successfully
Jun 26 05:51:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb522cd-4ed7-49cc-96b3-89e19877be46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Flow 'volume_create_manager' (274f1dba-c185-41f1-acf0-cf17f271f8fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:51:23 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-b752bbe1-5add-4a6d-92da-965351d25eeb tempest-VolumesListTestJSON-913116617 None] Created volume successfully.
Jun 26 05:51:23 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-49f47b52-43d6-452d-9c69-714854777ff1 tempest-AttachVolumeTestJSON-1893104206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8f31d85-a93a-4815-ab7a-3f49b239abb8" returned: 0 in 0.878s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-49f47b52-43d6-452d-9c69-714854777ff1 tempest-AttachVolumeTestJSON-1893104206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8f31d85-a93a-4815-ab7a-3f49b239abb8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:24 devstack sudo[104000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8f31d85-a93a-4815-ab7a-3f49b239abb8
Jun 26 05:51:24 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:24 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-49f47b52-43d6-452d-9c69-714854777ff1 tempest-AttachVolumeTestJSON-1893104206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a8f31d85-a93a-4815-ab7a-3f49b239abb8" returned: 0 in 0.725s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:24 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-49f47b52-43d6-452d-9c69-714854777ff1 tempest-AttachVolumeTestJSON-1893104206 None] Lock "cinder-quobyte-a8f31d85-a93a-4815-ab7a-3f49b239abb8" released by "delete_volume" :: held 1.657s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:24 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-49f47b52-43d6-452d-9c69-714854777ff1 tempest-AttachVolumeTestJSON-1893104206 None] Created reservations ['fd618158-8d2b-4b6b-94cc-f2ad2be6509b', '946c5854-ebf4-44b4-b75d-12ec44439b9b', 'c8b0f421-a564-432a-a22b-b15b966257c3', 'fcc70002-a034-460e-83b7-1e102f757fde'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:51:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-49f47b52-43d6-452d-9c69-714854777ff1 tempest-AttachVolumeTestJSON-1893104206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-49f47b52-43d6-452d-9c69-714854777ff1 tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-49f47b52-43d6-452d-9c69-714854777ff1 tempest-AttachVolumeTestJSON-1893104206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-49f47b52-43d6-452d-9c69-714854777ff1 tempest-AttachVolumeTestJSON-1893104206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-49f47b52-43d6-452d-9c69-714854777ff1 tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-49f47b52-43d6-452d-9c69-714854777ff1 tempest-AttachVolumeTestJSON-1893104206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:24 devstack sudo[104038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:51:24 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-95b7be76-0b9d-4e54-8e15-1acc7837faf4 tempest-AttachVolumeTestJSON-1893104206 None] Acquiring lock "cinder-c6ec87da-844b-4085-bfe5-0edda573cf64-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-95b7be76-0b9d-4e54-8e15-1acc7837faf4 tempest-AttachVolumeTestJSON-1893104206 None] Lock "cinder-c6ec87da-844b-4085-bfe5-0edda573cf64-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-95b7be76-0b9d-4e54-8e15-1acc7837faf4 tempest-AttachVolumeTestJSON-1893104206 None] Acquiring lock "cinder-quobyte-c6ec87da-844b-4085-bfe5-0edda573cf64" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-95b7be76-0b9d-4e54-8e15-1acc7837faf4 tempest-AttachVolumeTestJSON-1893104206 None] Lock "cinder-quobyte-c6ec87da-844b-4085-bfe5-0edda573cf64" acquired by "delete_volume" :: waited 0.021s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd757ea0-1e33-4e3d-9624-6293134d0c35]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-95b7be76-0b9d-4e54-8e15-1acc7837faf4 tempest-AttachVolumeTestJSON-1893104206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c6ec87da-844b-4085-bfe5-0edda573cf64 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Flow 'volume_create_manager' (4047b301-11b8-46ad-a77a-dab1f3487335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6ca246-d70a-4879-a8da-5bf6da2db4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6ca246-d70a-4879-a8da-5bf6da2db4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1353234119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e84ac40-1dba-49ac-9884-c97c5ba4a1b3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b37f94a9bc2341fe92bbdfa19e1b5ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:51:25Z,use_quota=True,user_id='cde5459f48cc4f5e86c0227da3923c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96229dc-6b9a-44c3-a181-8f4884d53ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96229dc-6b9a-44c3-a181-8f4884d53ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657b2a41-9689-4377-8004-de3bcef7010a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657b2a41-9689-4377-8004-de3bcef7010a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e84ac40-1dba-49ac-9884-c97c5ba4a1b3', 'volume_name': 'volume-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48072edd-a628-4f1f-9482-a119568dbaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48072edd-a628-4f1f-9482-a119568dbaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3b2ad8-5047-47df-9478-e5da6661edb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:25 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Volume 6e84ac40-1dba-49ac-9884-c97c5ba4a1b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3', 'volume_size': 1}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1353234119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e84ac40-1dba-49ac-9884-c97c5ba4a1b3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b37f94a9bc2341fe92bbdfa19e1b5ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:51:25Z,use_quota=True,user_id='cde5459f48cc4f5e86c0227da3923c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Creating volume 6e84ac40-1dba-49ac-9884-c97c5ba4a1b3 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:51:25 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:25 devstack sudo[104042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c6ec87da-844b-4085-bfe5-0edda573cf64
Jun 26 05:51:25 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:25 devstack sudo[104045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3 1073741824
Jun 26 05:51:25 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:25 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-49f47b52-43d6-452d-9c69-714854777ff1 tempest-AttachVolumeTestJSON-1893104206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.776s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-49f47b52-43d6-452d-9c69-714854777ff1 tempest-AttachVolumeTestJSON-1893104206 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:51:25 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-49f47b52-43d6-452d-9c69-714854777ff1 tempest-AttachVolumeTestJSON-1893104206 None] Deleted volume successfully.
Jun 26 05:51:25 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-49f47b52-43d6-452d-9c69-714854777ff1 tempest-AttachVolumeTestJSON-1893104206 None] Lock "cinder-a8f31d85-a93a-4815-ab7a-3f49b239abb8-delete_volume" released by "delete_volume" :: held 2.719s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:26 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-95b7be76-0b9d-4e54-8e15-1acc7837faf4 tempest-AttachVolumeTestJSON-1893104206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c6ec87da-844b-4085-bfe5-0edda573cf64" returned: 0 in 0.874s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-95b7be76-0b9d-4e54-8e15-1acc7837faf4 tempest-AttachVolumeTestJSON-1893104206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c6ec87da-844b-4085-bfe5-0edda573cf64 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:26 devstack sudo[104054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c6ec87da-844b-4085-bfe5-0edda573cf64
Jun 26 05:51:26 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:26 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3 1073741824" returned: 0 in 0.970s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:26 devstack sudo[104056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3
Jun 26 05:51:26 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:26 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-95b7be76-0b9d-4e54-8e15-1acc7837faf4 tempest-AttachVolumeTestJSON-1893104206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c6ec87da-844b-4085-bfe5-0edda573cf64" returned: 0 in 0.703s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-95b7be76-0b9d-4e54-8e15-1acc7837faf4 tempest-AttachVolumeTestJSON-1893104206 None] Lock "cinder-quobyte-c6ec87da-844b-4085-bfe5-0edda573cf64" released by "delete_volume" :: held 1.627s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-95b7be76-0b9d-4e54-8e15-1acc7837faf4 tempest-AttachVolumeTestJSON-1893104206 None] Created reservations ['422401e0-cb0f-42b8-a3ac-e9a021aaff6e', '15fe4bed-f6a2-48e4-b6df-f932d792f623', 'a8740706-08c5-4dd8-b719-0947a1bd0a63', '11a61ef8-2458-4f3c-adea-667595e2419e'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-95b7be76-0b9d-4e54-8e15-1acc7837faf4 tempest-AttachVolumeTestJSON-1893104206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-95b7be76-0b9d-4e54-8e15-1acc7837faf4 tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-95b7be76-0b9d-4e54-8e15-1acc7837faf4 tempest-AttachVolumeTestJSON-1893104206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-95b7be76-0b9d-4e54-8e15-1acc7837faf4 tempest-AttachVolumeTestJSON-1893104206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-95b7be76-0b9d-4e54-8e15-1acc7837faf4 tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-95b7be76-0b9d-4e54-8e15-1acc7837faf4 tempest-AttachVolumeTestJSON-1893104206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:27 devstack sudo[104068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:51:27 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:27 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3" returned: 0 in 0.723s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3b2ad8-5047-47df-9478-e5da6661edb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32ec0809-fe2f-40a2-a420-4ea89c0bd42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:27 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Volume volume-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3 (6e84ac40-1dba-49ac-9884-c97c5ba4a1b3): created successfully
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32ec0809-fe2f-40a2-a420-4ea89c0bd42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Flow 'volume_create_manager' (4047b301-11b8-46ad-a77a-dab1f3487335) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:51:27 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-55948857-9095-42fb-92ff-507758fbdcf9 tempest-VolumesListTestJSON-913116617 None] Created volume successfully.
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8248e1b7-d4b9-408a-ab8e-9b6881d8a10f tempest-AttachVolumeTestJSON-1893104206 None] Acquiring lock "cinder-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8248e1b7-d4b9-408a-ab8e-9b6881d8a10f tempest-AttachVolumeTestJSON-1893104206 None] Lock "cinder-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8248e1b7-d4b9-408a-ab8e-9b6881d8a10f tempest-AttachVolumeTestJSON-1893104206 None] Acquiring lock "cinder-quobyte-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8248e1b7-d4b9-408a-ab8e-9b6881d8a10f tempest-AttachVolumeTestJSON-1893104206 None] Lock "cinder-quobyte-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe" acquired by "delete_volume" :: waited 0.033s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10c0c37-0868-4786-9bfd-a859f9e99807]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8248e1b7-d4b9-408a-ab8e-9b6881d8a10f tempest-AttachVolumeTestJSON-1893104206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:27 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-95b7be76-0b9d-4e54-8e15-1acc7837faf4 tempest-AttachVolumeTestJSON-1893104206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.742s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-95b7be76-0b9d-4e54-8e15-1acc7837faf4 tempest-AttachVolumeTestJSON-1893104206 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:51:27 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-95b7be76-0b9d-4e54-8e15-1acc7837faf4 tempest-AttachVolumeTestJSON-1893104206 None] Deleted volume successfully.
Jun 26 05:51:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-95b7be76-0b9d-4e54-8e15-1acc7837faf4 tempest-AttachVolumeTestJSON-1893104206 None] Lock "cinder-c6ec87da-844b-4085-bfe5-0edda573cf64-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:27 devstack sudo[104071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe
Jun 26 05:51:27 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Flow 'volume_create_manager' (d183c9ed-0795-4a58-b727-8367ff288aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1026fefe-a867-4624-ad6e-e3af18d39882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1026fefe-a867-4624-ad6e-e3af18d39882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-54146061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e86986b-10c9-4ba5-b29d-7515c792edf2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b37f94a9bc2341fe92bbdfa19e1b5ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:51:28Z,use_quota=True,user_id='cde5459f48cc4f5e86c0227da3923c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e6fd45-2693-4ff6-8de9-a5254595f3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e6fd45-2693-4ff6-8de9-a5254595f3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd11a6b3-9f6f-44cb-b54b-314cb2172513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd11a6b3-9f6f-44cb-b54b-314cb2172513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e86986b-10c9-4ba5-b29d-7515c792edf2', 'volume_name': 'volume-3e86986b-10c9-4ba5-b29d-7515c792edf2', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b434655-3dd0-4851-bdf7-9ef4a3449a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b434655-3dd0-4851-bdf7-9ef4a3449a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5587e1-f734-4ec8-88b2-7e000db2710a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:28 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Volume 3e86986b-10c9-4ba5-b29d-7515c792edf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e86986b-10c9-4ba5-b29d-7515c792edf2', 'volume_size': 1}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-54146061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e86986b-10c9-4ba5-b29d-7515c792edf2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b37f94a9bc2341fe92bbdfa19e1b5ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:51:28Z,use_quota=True,user_id='cde5459f48cc4f5e86c0227da3923c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Creating volume 3e86986b-10c9-4ba5-b29d-7515c792edf2 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:51:28 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3e86986b-10c9-4ba5-b29d-7515c792edf2 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:28 devstack sudo[104073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3e86986b-10c9-4ba5-b29d-7515c792edf2 1073741824
Jun 26 05:51:28 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Flow 'volume_create_manager' (cbb47e42-c181-4f30-939c-4d397969b0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd4e05b-3296-4d05-9a93-d533a6e0da00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd4e05b-3296-4d05-9a93-d533a6e0da00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1352066376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1d1466f1d94f7e91947be8ada55971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:51:29Z,use_quota=True,user_id='5f41366cccb84013b42c944c6d4cc19d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3882e2-e559-45da-aac6-22456d55b9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3882e2-e559-45da-aac6-22456d55b9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e98d3d4-929a-4455-8173-9474d1f781a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e98d3d4-929a-4455-8173-9474d1f781a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7', 'volume_name': 'volume-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a213471-2ce2-42d8-9f2d-977343aef1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a213471-2ce2-42d8-9f2d-977343aef1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470ea836-0a53-4f59-ab66-8f399043e006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:28 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Volume ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7', 'volume_size': 1}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:28 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8248e1b7-d4b9-408a-ab8e-9b6881d8a10f tempest-AttachVolumeTestJSON-1893104206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe" returned: 0 in 0.959s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8248e1b7-d4b9-408a-ab8e-9b6881d8a10f tempest-AttachVolumeTestJSON-1893104206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:28 devstack sudo[104078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe
Jun 26 05:51:28 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:29 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3e86986b-10c9-4ba5-b29d-7515c792edf2 1073741824" returned: 0 in 0.889s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3e86986b-10c9-4ba5-b29d-7515c792edf2 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:29 devstack sudo[104084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3e86986b-10c9-4ba5-b29d-7515c792edf2
Jun 26 05:51:29 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:29 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8248e1b7-d4b9-408a-ab8e-9b6881d8a10f tempest-AttachVolumeTestJSON-1893104206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe" returned: 0 in 0.709s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8248e1b7-d4b9-408a-ab8e-9b6881d8a10f tempest-AttachVolumeTestJSON-1893104206 None] Lock "cinder-quobyte-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe" released by "delete_volume" :: held 1.719s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-8248e1b7-d4b9-408a-ab8e-9b6881d8a10f tempest-AttachVolumeTestJSON-1893104206 None] Created reservations ['a73bd560-8a70-4a27-92e1-afb2ea786be9', '8aa1188c-79c3-4bc3-ac23-f0ffe68b230b', '360ea756-d8c1-430f-bd93-8f72c6d2b7c2', 'e0644e53-c73a-4dd7-9d50-5636cb1f1fb9'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8248e1b7-d4b9-408a-ab8e-9b6881d8a10f tempest-AttachVolumeTestJSON-1893104206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8248e1b7-d4b9-408a-ab8e-9b6881d8a10f tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8248e1b7-d4b9-408a-ab8e-9b6881d8a10f tempest-AttachVolumeTestJSON-1893104206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8248e1b7-d4b9-408a-ab8e-9b6881d8a10f tempest-AttachVolumeTestJSON-1893104206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8248e1b7-d4b9-408a-ab8e-9b6881d8a10f tempest-AttachVolumeTestJSON-1893104206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8248e1b7-d4b9-408a-ab8e-9b6881d8a10f tempest-AttachVolumeTestJSON-1893104206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:29 devstack sudo[104087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:51:29 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:29 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3e86986b-10c9-4ba5-b29d-7515c792edf2" returned: 0 in 0.741s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.255s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1352066376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1d1466f1d94f7e91947be8ada55971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:51:29Z,use_quota=True,user_id='5f41366cccb84013b42c944c6d4cc19d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Creating volume ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:51:29 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:51:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5587e1-f734-4ec8-88b2-7e000db2710a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e86986b-10c9-4ba5-b29d-7515c792edf2', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:30 devstack sudo[104098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7 1073741824
Jun 26 05:51:30 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf073ce-2b5d-4d5d-970e-6892a683308b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:30 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Volume volume-3e86986b-10c9-4ba5-b29d-7515c792edf2 (3e86986b-10c9-4ba5-b29d-7515c792edf2): created successfully
Jun 26 05:51:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf073ce-2b5d-4d5d-970e-6892a683308b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Flow 'volume_create_manager' (d183c9ed-0795-4a58-b727-8367ff288aa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:51:30 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-bf2c56eb-e929-41b6-a071-60f46e631169 tempest-VolumesListTestJSON-913116617 None] Created volume successfully.
Jun 26 05:51:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-b564683a-ad0b-4f8d-9c60-f2840c63b35a req-eb06a464-ed93-43e8-83ba-9e39663acf74 tempest-TestInstancesWithCinderVolumes-1417758814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:30 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8248e1b7-d4b9-408a-ab8e-9b6881d8a10f tempest-AttachVolumeTestJSON-1893104206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.852s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:30 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-8248e1b7-d4b9-408a-ab8e-9b6881d8a10f tempest-AttachVolumeTestJSON-1893104206 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:51:30 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-8248e1b7-d4b9-408a-ab8e-9b6881d8a10f tempest-AttachVolumeTestJSON-1893104206 None] Deleted volume successfully.
Jun 26 05:51:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8248e1b7-d4b9-408a-ab8e-9b6881d8a10f tempest-AttachVolumeTestJSON-1893104206 None] Lock "cinder-c5b3a735-8d0f-4d23-9d04-a6f02f0a59fe-delete_volume" released by "delete_volume" :: held 2.846s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:31 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7 1073741824" returned: 0 in 1.075s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:31 devstack sudo[104104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7
Jun 26 05:51:31 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:31 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7" returned: 0 in 0.704s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:51:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-b564683a-ad0b-4f8d-9c60-f2840c63b35a req-eb06a464-ed93-43e8-83ba-9e39663acf74 tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.612s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:31 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[f662f02c-98cf-4d5e-9b4c-f598293c53be]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:51:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-b564683a-ad0b-4f8d-9c60-f2840c63b35a req-eb06a464-ed93-43e8-83ba-9e39663acf74 tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aae51433-0a2e-4458-86ed-5f137f9e6cfd {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:31 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470ea836-0a53-4f59-ab66-8f399043e006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:31 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a95571-6073-40f7-be57-6c565b065c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:31 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Volume volume-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7 (ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7): created successfully
Jun 26 05:51:31 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a95571-6073-40f7-be57-6c565b065c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:31 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Flow 'volume_create_manager' (cbb47e42-c181-4f30-939c-4d397969b0da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:51:31 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-25ac5c54-0cc0-481f-8407-940c974e7140 tempest-VolumesActionsTest-1876783963 None] Created volume successfully.
Jun 26 05:51:31 devstack sudo[104108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aae51433-0a2e-4458-86ed-5f137f9e6cfd
Jun 26 05:51:31 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f86c9ce1-c639-40ac-974d-f034e3155bd7 tempest-VolumesActionsTest-450281722 None] Acquiring lock "cinder-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f86c9ce1-c639-40ac-974d-f034e3155bd7 tempest-VolumesActionsTest-450281722 None] Lock "cinder-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f86c9ce1-c639-40ac-974d-f034e3155bd7 tempest-VolumesActionsTest-450281722 None] Acquiring lock "cinder-quobyte-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f86c9ce1-c639-40ac-974d-f034e3155bd7 tempest-VolumesActionsTest-450281722 None] Lock "cinder-quobyte-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7" acquired by "delete_volume" :: waited 0.032s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:32 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b60e7f-0d1d-4c20-9c4e-420ba34a8f53]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:51:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f86c9ce1-c639-40ac-974d-f034e3155bd7 tempest-VolumesActionsTest-450281722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:32 devstack sudo[104114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7
Jun 26 05:51:32 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:32 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-b564683a-ad0b-4f8d-9c60-f2840c63b35a req-eb06a464-ed93-43e8-83ba-9e39663acf74 tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aae51433-0a2e-4458-86ed-5f137f9e6cfd" returned: 0 in 1.009s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-b564683a-ad0b-4f8d-9c60-f2840c63b35a req-eb06a464-ed93-43e8-83ba-9e39663acf74 tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.031s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:32 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-b564683a-ad0b-4f8d-9c60-f2840c63b35a req-eb06a464-ed93-43e8-83ba-9e39663acf74 tempest-TestInstancesWithCinderVolumes-1417758814 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85', 'name': 'volume-aae51433-0a2e-4458-86ed-5f137f9e6cfd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1180c07c-ac5e-4734-b786-b4d25acf075a', 'enforce_multipath': True} {{(pid=93708) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 05:51:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-02983625-21d7-40df-a7f9-898bdadb5230 tempest-VolumesListTestJSON-913116617 None] Acquiring lock "cinder-3e86986b-10c9-4ba5-b29d-7515c792edf2-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:32 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-b564683a-ad0b-4f8d-9c60-f2840c63b35a req-eb06a464-ed93-43e8-83ba-9e39663acf74 tempest-TestInstancesWithCinderVolumes-1417758814 None] attachment_update completed successfully.
Jun 26 05:51:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-02983625-21d7-40df-a7f9-898bdadb5230 tempest-VolumesListTestJSON-913116617 None] Lock "cinder-3e86986b-10c9-4ba5-b29d-7515c792edf2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:33 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-02983625-21d7-40df-a7f9-898bdadb5230 tempest-VolumesListTestJSON-913116617 None] Acquiring lock "cinder-quobyte-3e86986b-10c9-4ba5-b29d-7515c792edf2" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:33 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-02983625-21d7-40df-a7f9-898bdadb5230 tempest-VolumesListTestJSON-913116617 None] Lock "cinder-quobyte-3e86986b-10c9-4ba5-b29d-7515c792edf2" acquired by "delete_volume" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:33 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f335228-d129-4755-89ab-d25e7d3e775e]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:51:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-02983625-21d7-40df-a7f9-898bdadb5230 tempest-VolumesListTestJSON-913116617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3e86986b-10c9-4ba5-b29d-7515c792edf2 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:33 devstack sudo[104116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3e86986b-10c9-4ba5-b29d-7515c792edf2
Jun 26 05:51:33 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:33 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f86c9ce1-c639-40ac-974d-f034e3155bd7 tempest-VolumesActionsTest-450281722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7" returned: 0 in 1.085s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f86c9ce1-c639-40ac-974d-f034e3155bd7 tempest-VolumesActionsTest-450281722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:33 devstack sudo[104121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7
Jun 26 05:51:33 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:34 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-02983625-21d7-40df-a7f9-898bdadb5230 tempest-VolumesListTestJSON-913116617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3e86986b-10c9-4ba5-b29d-7515c792edf2" returned: 0 in 1.119s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-02983625-21d7-40df-a7f9-898bdadb5230 tempest-VolumesListTestJSON-913116617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3e86986b-10c9-4ba5-b29d-7515c792edf2 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:34 devstack sudo[104131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3e86986b-10c9-4ba5-b29d-7515c792edf2
Jun 26 05:51:34 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:34 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f86c9ce1-c639-40ac-974d-f034e3155bd7 tempest-VolumesActionsTest-450281722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7" returned: 0 in 0.890s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f86c9ce1-c639-40ac-974d-f034e3155bd7 tempest-VolumesActionsTest-450281722 None] Lock "cinder-quobyte-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7" released by "delete_volume" :: held 2.026s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:34 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-f86c9ce1-c639-40ac-974d-f034e3155bd7 tempest-VolumesActionsTest-450281722 None] Created reservations ['4d3cc7a6-f911-4999-87e5-dafa2872316e', '9bd6fa5b-e609-40cf-bce8-f70dcac20bcb', 'efbf892d-6727-4091-9389-cdacb0dde6be', 'c57de5e8-6344-4833-b51a-007ae59dc257'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:51:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f86c9ce1-c639-40ac-974d-f034e3155bd7 tempest-VolumesActionsTest-450281722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f86c9ce1-c639-40ac-974d-f034e3155bd7 tempest-VolumesActionsTest-450281722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:34 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f86c9ce1-c639-40ac-974d-f034e3155bd7 tempest-VolumesActionsTest-450281722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:34 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f86c9ce1-c639-40ac-974d-f034e3155bd7 tempest-VolumesActionsTest-450281722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f86c9ce1-c639-40ac-974d-f034e3155bd7 tempest-VolumesActionsTest-450281722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f86c9ce1-c639-40ac-974d-f034e3155bd7 tempest-VolumesActionsTest-450281722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:34 devstack sudo[104135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:51:34 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:35 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-02983625-21d7-40df-a7f9-898bdadb5230 tempest-VolumesListTestJSON-913116617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3e86986b-10c9-4ba5-b29d-7515c792edf2" returned: 0 in 0.869s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-02983625-21d7-40df-a7f9-898bdadb5230 tempest-VolumesListTestJSON-913116617 None] Lock "cinder-quobyte-3e86986b-10c9-4ba5-b29d-7515c792edf2" released by "delete_volume" :: held 2.041s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:35 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-02983625-21d7-40df-a7f9-898bdadb5230 tempest-VolumesListTestJSON-913116617 None] Created reservations ['e4bbde82-3ef6-4b39-944f-759795ac61d0', '3d7293ce-e1ac-4003-bb1e-7f498c149df3', 'f753a6ef-97c7-4a24-96ff-71a794d04aec', '5f361cf4-7de6-48cf-9df9-73edbfe13464'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:51:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-02983625-21d7-40df-a7f9-898bdadb5230 tempest-VolumesListTestJSON-913116617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-02983625-21d7-40df-a7f9-898bdadb5230 tempest-VolumesListTestJSON-913116617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:35 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-02983625-21d7-40df-a7f9-898bdadb5230 tempest-VolumesListTestJSON-913116617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:35 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-02983625-21d7-40df-a7f9-898bdadb5230 tempest-VolumesListTestJSON-913116617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-02983625-21d7-40df-a7f9-898bdadb5230 tempest-VolumesListTestJSON-913116617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-02983625-21d7-40df-a7f9-898bdadb5230 tempest-VolumesListTestJSON-913116617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:35 devstack sudo[104138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:51:35 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1abefaa5-1e8f-4a6e-bda1-5c8d2bd5109e tempest-VolumesListTestJSON-913116617 None] Acquiring lock "cinder-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1abefaa5-1e8f-4a6e-bda1-5c8d2bd5109e tempest-VolumesListTestJSON-913116617 None] Lock "cinder-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1abefaa5-1e8f-4a6e-bda1-5c8d2bd5109e tempest-VolumesListTestJSON-913116617 None] Acquiring lock "cinder-quobyte-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1abefaa5-1e8f-4a6e-bda1-5c8d2bd5109e tempest-VolumesListTestJSON-913116617 None] Lock "cinder-quobyte-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3" acquired by "delete_volume" :: waited 0.020s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:35 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8d6df7-e8b1-4b5a-9ce0-14cd9913b2e1]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:51:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1abefaa5-1e8f-4a6e-bda1-5c8d2bd5109e tempest-VolumesListTestJSON-913116617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:35 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f86c9ce1-c639-40ac-974d-f034e3155bd7 tempest-VolumesActionsTest-450281722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.745s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:35 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-f86c9ce1-c639-40ac-974d-f034e3155bd7 tempest-VolumesActionsTest-450281722 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:51:35 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-f86c9ce1-c639-40ac-974d-f034e3155bd7 tempest-VolumesActionsTest-450281722 None] Deleted volume successfully.
Jun 26 05:51:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f86c9ce1-c639-40ac-974d-f034e3155bd7 tempest-VolumesActionsTest-450281722 None] Lock "cinder-ec1625e5-73ca-4ed2-a0c4-c95ecfb31bf7-delete_volume" released by "delete_volume" :: held 3.112s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:35 devstack sudo[104141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3
Jun 26 05:51:35 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:36 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-02983625-21d7-40df-a7f9-898bdadb5230 tempest-VolumesListTestJSON-913116617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.869s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-02983625-21d7-40df-a7f9-898bdadb5230 tempest-VolumesListTestJSON-913116617 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:51:36 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-02983625-21d7-40df-a7f9-898bdadb5230 tempest-VolumesListTestJSON-913116617 None] Deleted volume successfully.
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-02983625-21d7-40df-a7f9-898bdadb5230 tempest-VolumesListTestJSON-913116617 None] Lock "cinder-3e86986b-10c9-4ba5-b29d-7515c792edf2-delete_volume" released by "delete_volume" :: held 3.138s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:36 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1abefaa5-1e8f-4a6e-bda1-5c8d2bd5109e tempest-VolumesListTestJSON-913116617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3" returned: 0 in 1.028s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1abefaa5-1e8f-4a6e-bda1-5c8d2bd5109e tempest-VolumesListTestJSON-913116617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:36 devstack sudo[104147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3
Jun 26 05:51:36 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Flow 'volume_create_manager' (6cde65f6-8105-4f55-8cbf-40cf88285412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d7fb23-85a6-401f-b91e-357c62afddb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d7fb23-85a6-401f-b91e-357c62afddb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-731316509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1d1466f1d94f7e91947be8ada55971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:51:36Z,use_quota=True,user_id='5f41366cccb84013b42c944c6d4cc19d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4263da9-842b-4d26-8506-0d8442c3dfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4263da9-842b-4d26-8506-0d8442c3dfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a11238-5352-4af3-ba11-23a27ac71d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a11238-5352-4af3-ba11-23a27ac71d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92', 'volume_name': 'volume-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc5ce75b-cf0a-4be5-9430-d50406defa98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc5ce75b-cf0a-4be5-9430-d50406defa98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b282de20-6413-4a01-8405-a83fcfae70f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:36 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Volume 5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92', 'volume_size': 1}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-731316509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1d1466f1d94f7e91947be8ada55971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:51:36Z,use_quota=True,user_id='5f41366cccb84013b42c944c6d4cc19d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Creating volume 5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:51:36 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:51:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:36 devstack sudo[104149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92 1073741824
Jun 26 05:51:36 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:37 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1abefaa5-1e8f-4a6e-bda1-5c8d2bd5109e tempest-VolumesListTestJSON-913116617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3" returned: 0 in 0.727s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1abefaa5-1e8f-4a6e-bda1-5c8d2bd5109e tempest-VolumesListTestJSON-913116617 None] Lock "cinder-quobyte-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3" released by "delete_volume" :: held 1.816s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:37 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-1abefaa5-1e8f-4a6e-bda1-5c8d2bd5109e tempest-VolumesListTestJSON-913116617 None] Created reservations ['e665bb98-aa88-462a-96b3-ce6ae7b163ba', '09c97662-af18-466e-bc08-818760f715b4', '853c3664-e22b-4697-8e4b-8de24907707c', '30a971f5-5ee7-41ce-adae-d15e678b61af'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:51:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1abefaa5-1e8f-4a6e-bda1-5c8d2bd5109e tempest-VolumesListTestJSON-913116617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1abefaa5-1e8f-4a6e-bda1-5c8d2bd5109e tempest-VolumesListTestJSON-913116617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:37 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-1abefaa5-1e8f-4a6e-bda1-5c8d2bd5109e tempest-VolumesListTestJSON-913116617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:37 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-1abefaa5-1e8f-4a6e-bda1-5c8d2bd5109e tempest-VolumesListTestJSON-913116617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1abefaa5-1e8f-4a6e-bda1-5c8d2bd5109e tempest-VolumesListTestJSON-913116617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1abefaa5-1e8f-4a6e-bda1-5c8d2bd5109e tempest-VolumesListTestJSON-913116617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:37 devstack sudo[104155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:51:37 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:37 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92 1073741824" returned: 0 in 1.040s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4d0f8a34-be70-4bc9-9a6d-f053fea09da1 tempest-VolumesListTestJSON-913116617 None] Acquiring lock "cinder-cd438d1b-1463-4e22-aecb-472080b48779-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4d0f8a34-be70-4bc9-9a6d-f053fea09da1 tempest-VolumesListTestJSON-913116617 None] Lock "cinder-cd438d1b-1463-4e22-aecb-472080b48779-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:37 devstack sudo[104159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92
Jun 26 05:51:37 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4d0f8a34-be70-4bc9-9a6d-f053fea09da1 tempest-VolumesListTestJSON-913116617 None] Acquiring lock "cinder-quobyte-cd438d1b-1463-4e22-aecb-472080b48779" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4d0f8a34-be70-4bc9-9a6d-f053fea09da1 tempest-VolumesListTestJSON-913116617 None] Lock "cinder-quobyte-cd438d1b-1463-4e22-aecb-472080b48779" acquired by "delete_volume" :: waited 0.039s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:38 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34d43d5-9543-4d55-85d2-af754e3e7cb3]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:51:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4d0f8a34-be70-4bc9-9a6d-f053fea09da1 tempest-VolumesListTestJSON-913116617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-cd438d1b-1463-4e22-aecb-472080b48779 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:38 devstack sudo[104163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-cd438d1b-1463-4e22-aecb-472080b48779
Jun 26 05:51:38 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:38 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1abefaa5-1e8f-4a6e-bda1-5c8d2bd5109e tempest-VolumesListTestJSON-913116617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.843s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:38 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-1abefaa5-1e8f-4a6e-bda1-5c8d2bd5109e tempest-VolumesListTestJSON-913116617 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:51:38 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-1abefaa5-1e8f-4a6e-bda1-5c8d2bd5109e tempest-VolumesListTestJSON-913116617 None] Deleted volume successfully.
Jun 26 05:51:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1abefaa5-1e8f-4a6e-bda1-5c8d2bd5109e tempest-VolumesListTestJSON-913116617 None] Lock "cinder-6e84ac40-1dba-49ac-9884-c97c5ba4a1b3-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:38 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92" returned: 0 in 0.928s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:38 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] <== create_volume: return (2091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:51:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.093s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b282de20-6413-4a01-8405-a83fcfae70f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e23a4d6-5a5c-4493-af19-4d3f5e417771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:38 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Volume volume-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92 (5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92): created successfully
Jun 26 05:51:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e23a4d6-5a5c-4493-af19-4d3f5e417771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Flow 'volume_create_manager' (6cde65f6-8105-4f55-8cbf-40cf88285412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:51:38 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-3c0cce53-fc11-4d2e-b9d8-ce6d6d27011a tempest-VolumesActionsTest-1876783963 None] Created volume successfully.
Jun 26 05:51:39 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4d0f8a34-be70-4bc9-9a6d-f053fea09da1 tempest-VolumesListTestJSON-913116617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-cd438d1b-1463-4e22-aecb-472080b48779" returned: 0 in 1.044s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4d0f8a34-be70-4bc9-9a6d-f053fea09da1 tempest-VolumesListTestJSON-913116617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-cd438d1b-1463-4e22-aecb-472080b48779 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:39 devstack sudo[104176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-cd438d1b-1463-4e22-aecb-472080b48779
Jun 26 05:51:39 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:39 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4d0f8a34-be70-4bc9-9a6d-f053fea09da1 tempest-VolumesListTestJSON-913116617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-cd438d1b-1463-4e22-aecb-472080b48779" returned: 0 in 0.673s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4d0f8a34-be70-4bc9-9a6d-f053fea09da1 tempest-VolumesListTestJSON-913116617 None] Lock "cinder-quobyte-cd438d1b-1463-4e22-aecb-472080b48779" released by "delete_volume" :: held 1.785s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:39 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-4d0f8a34-be70-4bc9-9a6d-f053fea09da1 tempest-VolumesListTestJSON-913116617 None] Created reservations ['cd3cab91-8506-40f9-9cf7-cf568b6d06bf', '8aaa3643-6107-4cdd-830e-079a4599bc65', '69e1daf4-fd44-4b88-b431-a25fd64fcf86', 'd0d3a6d7-e9fe-4cc9-8ed6-22e2d9f77b15'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:51:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e40d448c-7ac3-444b-8d81-348ca11b0701 tempest-VolumesActionsTest-450281722 None] Acquiring lock "cinder-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e40d448c-7ac3-444b-8d81-348ca11b0701 tempest-VolumesActionsTest-450281722 None] Lock "cinder-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e40d448c-7ac3-444b-8d81-348ca11b0701 tempest-VolumesActionsTest-450281722 None] Acquiring lock "cinder-quobyte-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4d0f8a34-be70-4bc9-9a6d-f053fea09da1 tempest-VolumesListTestJSON-913116617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4d0f8a34-be70-4bc9-9a6d-f053fea09da1 tempest-VolumesListTestJSON-913116617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4d0f8a34-be70-4bc9-9a6d-f053fea09da1 tempest-VolumesListTestJSON-913116617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4d0f8a34-be70-4bc9-9a6d-f053fea09da1 tempest-VolumesListTestJSON-913116617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4d0f8a34-be70-4bc9-9a6d-f053fea09da1 tempest-VolumesListTestJSON-913116617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4d0f8a34-be70-4bc9-9a6d-f053fea09da1 tempest-VolumesListTestJSON-913116617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e40d448c-7ac3-444b-8d81-348ca11b0701 tempest-VolumesActionsTest-450281722 None] Lock "cinder-quobyte-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92" acquired by "delete_volume" :: waited 0.050s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:40 devstack sudo[104179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:51:40 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:40 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c0b182-c307-450f-9c9b-f94035f9104b]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:51:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e40d448c-7ac3-444b-8d81-348ca11b0701 tempest-VolumesActionsTest-450281722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:40 devstack sudo[104181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92
Jun 26 05:51:40 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:40 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4d0f8a34-be70-4bc9-9a6d-f053fea09da1 tempest-VolumesListTestJSON-913116617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.900s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:40 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-4d0f8a34-be70-4bc9-9a6d-f053fea09da1 tempest-VolumesListTestJSON-913116617 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:51:40 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-4d0f8a34-be70-4bc9-9a6d-f053fea09da1 tempest-VolumesListTestJSON-913116617 None] Deleted volume successfully.
Jun 26 05:51:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4d0f8a34-be70-4bc9-9a6d-f053fea09da1 tempest-VolumesListTestJSON-913116617 None] Lock "cinder-cd438d1b-1463-4e22-aecb-472080b48779-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:41 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e40d448c-7ac3-444b-8d81-348ca11b0701 tempest-VolumesActionsTest-450281722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92" returned: 0 in 1.080s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e40d448c-7ac3-444b-8d81-348ca11b0701 tempest-VolumesActionsTest-450281722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:41 devstack sudo[104188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92
Jun 26 05:51:41 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-ee2695bd-940e-4003-98df-5fc58c2fe14a req-22da18d2-796e-4266-aca9-e8f9e8108b31 tempest-TestInstancesWithCinderVolumes-1417758814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-ee2695bd-940e-4003-98df-5fc58c2fe14a req-22da18d2-796e-4266-aca9-e8f9e8108b31 tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:41 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fe3c48-4cc5-46d0-98b6-3928ee50ccad]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:51:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-ee2695bd-940e-4003-98df-5fc58c2fe14a req-22da18d2-796e-4266-aca9-e8f9e8108b31 tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-92e06ab3-f7f0-4949-b79a-81bb173f2c06 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:41 devstack sudo[104198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-92e06ab3-f7f0-4949-b79a-81bb173f2c06
Jun 26 05:51:41 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:41 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e40d448c-7ac3-444b-8d81-348ca11b0701 tempest-VolumesActionsTest-450281722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92" returned: 0 in 0.859s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e40d448c-7ac3-444b-8d81-348ca11b0701 tempest-VolumesActionsTest-450281722 None] Lock "cinder-quobyte-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92" released by "delete_volume" :: held 2.003s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:42 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-e40d448c-7ac3-444b-8d81-348ca11b0701 tempest-VolumesActionsTest-450281722 None] Created reservations ['65107ca7-ef00-4d73-a46a-b14311f9a140', '7bd7dde8-98a7-413e-aa87-ee3554edf7e6', '248fb9d7-b76f-4575-a29e-88d104c2094d', 'b814845c-f05e-453c-acf9-c17caf6d7e63'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:51:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e40d448c-7ac3-444b-8d81-348ca11b0701 tempest-VolumesActionsTest-450281722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e40d448c-7ac3-444b-8d81-348ca11b0701 tempest-VolumesActionsTest-450281722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e40d448c-7ac3-444b-8d81-348ca11b0701 tempest-VolumesActionsTest-450281722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e40d448c-7ac3-444b-8d81-348ca11b0701 tempest-VolumesActionsTest-450281722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e40d448c-7ac3-444b-8d81-348ca11b0701 tempest-VolumesActionsTest-450281722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e40d448c-7ac3-444b-8d81-348ca11b0701 tempest-VolumesActionsTest-450281722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:42 devstack sudo[104202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:51:42 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:42 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-ee2695bd-940e-4003-98df-5fc58c2fe14a req-22da18d2-796e-4266-aca9-e8f9e8108b31 tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-92e06ab3-f7f0-4949-b79a-81bb173f2c06" returned: 0 in 1.122s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-ee2695bd-940e-4003-98df-5fc58c2fe14a req-22da18d2-796e-4266-aca9-e8f9e8108b31 tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.182s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:42 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-ee2695bd-940e-4003-98df-5fc58c2fe14a req-22da18d2-796e-4266-aca9-e8f9e8108b31 tempest-TestInstancesWithCinderVolumes-1417758814 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85', 'name': 'volume-92e06ab3-f7f0-4949-b79a-81bb173f2c06', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2cab775-b7bd-47cd-8fdd-4d9df4ebfe25', 'enforce_multipath': True} {{(pid=93708) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 05:51:42 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-ee2695bd-940e-4003-98df-5fc58c2fe14a req-22da18d2-796e-4266-aca9-e8f9e8108b31 tempest-TestInstancesWithCinderVolumes-1417758814 None] attachment_update completed successfully.
Jun 26 05:51:43 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e40d448c-7ac3-444b-8d81-348ca11b0701 tempest-VolumesActionsTest-450281722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.783s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:43 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-e40d448c-7ac3-444b-8d81-348ca11b0701 tempest-VolumesActionsTest-450281722 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:51:43 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e40d448c-7ac3-444b-8d81-348ca11b0701 tempest-VolumesActionsTest-450281722 None] Deleted volume successfully.
Jun 26 05:51:43 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e40d448c-7ac3-444b-8d81-348ca11b0701 tempest-VolumesActionsTest-450281722 None] Lock "cinder-5f63e5cb-30cc-4a3a-a29e-9a6c1bb9af92-delete_volume" released by "delete_volume" :: held 3.179s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Flow 'volume_create_manager' (1cf38811-27cd-4afd-b8d2-a3cb46f368e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8950b113-d51c-4e89-826c-7939746bdf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8950b113-d51c-4e89-826c-7939746bdf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1245355336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c75218-7ac1-4117-b9fb-904097d40912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1d1466f1d94f7e91947be8ada55971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:51:44Z,use_quota=True,user_id='5f41366cccb84013b42c944c6d4cc19d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e37ad33-7056-498e-9c96-1a70d59df801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e37ad33-7056-498e-9c96-1a70d59df801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156354f3-5a8c-4a18-9316-660c31748845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156354f3-5a8c-4a18-9316-660c31748845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c75218-7ac1-4117-b9fb-904097d40912', 'volume_name': 'volume-70c75218-7ac1-4117-b9fb-904097d40912', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647789a8-bd36-4f80-8b97-0d23d99a60a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647789a8-bd36-4f80-8b97-0d23d99a60a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a574c0-592d-40b5-aa57-57391208796d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:44 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Volume 70c75218-7ac1-4117-b9fb-904097d40912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c75218-7ac1-4117-b9fb-904097d40912', 'volume_size': 1}
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1245355336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c75218-7ac1-4117-b9fb-904097d40912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1d1466f1d94f7e91947be8ada55971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:51:44Z,use_quota=True,user_id='5f41366cccb84013b42c944c6d4cc19d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Creating volume 70c75218-7ac1-4117-b9fb-904097d40912 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:51:44 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:51:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-70c75218-7ac1-4117-b9fb-904097d40912 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:44 devstack sudo[104213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-70c75218-7ac1-4117-b9fb-904097d40912 1073741824
Jun 26 05:51:44 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:45 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-70c75218-7ac1-4117-b9fb-904097d40912 1073741824" returned: 0 in 1.112s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-70c75218-7ac1-4117-b9fb-904097d40912 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:45 devstack sudo[104219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-70c75218-7ac1-4117-b9fb-904097d40912
Jun 26 05:51:45 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:46 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-70c75218-7ac1-4117-b9fb-904097d40912" returned: 0 in 0.767s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:46 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:51:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a574c0-592d-40b5-aa57-57391208796d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c75218-7ac1-4117-b9fb-904097d40912', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a6eed5-6891-4b84-a450-d6f8466975a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:46 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Volume volume-70c75218-7ac1-4117-b9fb-904097d40912 (70c75218-7ac1-4117-b9fb-904097d40912): created successfully
Jun 26 05:51:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a6eed5-6891-4b84-a450-d6f8466975a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:46 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Flow 'volume_create_manager' (1cf38811-27cd-4afd-b8d2-a3cb46f368e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:51:46 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-4748d264-a8d1-48e1-b11f-1248d93781ea tempest-VolumesActionsTest-1876783963 None] Created volume successfully.
Jun 26 05:51:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c1bfb297-0041-40cb-be72-3542ec469ca7 tempest-VolumesActionsTest-450281722 None] Acquiring lock "cinder-70c75218-7ac1-4117-b9fb-904097d40912-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c1bfb297-0041-40cb-be72-3542ec469ca7 tempest-VolumesActionsTest-450281722 None] Lock "cinder-70c75218-7ac1-4117-b9fb-904097d40912-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c1bfb297-0041-40cb-be72-3542ec469ca7 tempest-VolumesActionsTest-450281722 None] Acquiring lock "cinder-quobyte-70c75218-7ac1-4117-b9fb-904097d40912" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c1bfb297-0041-40cb-be72-3542ec469ca7 tempest-VolumesActionsTest-450281722 None] Lock "cinder-quobyte-70c75218-7ac1-4117-b9fb-904097d40912" acquired by "delete_volume" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:47 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ef70f9-7214-48b2-912c-a9c04b22ab5b]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:51:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c1bfb297-0041-40cb-be72-3542ec469ca7 tempest-VolumesActionsTest-450281722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-70c75218-7ac1-4117-b9fb-904097d40912 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:47 devstack sudo[104222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-70c75218-7ac1-4117-b9fb-904097d40912
Jun 26 05:51:47 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:48 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c1bfb297-0041-40cb-be72-3542ec469ca7 tempest-VolumesActionsTest-450281722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-70c75218-7ac1-4117-b9fb-904097d40912" returned: 0 in 1.219s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c1bfb297-0041-40cb-be72-3542ec469ca7 tempest-VolumesActionsTest-450281722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-70c75218-7ac1-4117-b9fb-904097d40912 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:48 devstack sudo[104235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-70c75218-7ac1-4117-b9fb-904097d40912
Jun 26 05:51:48 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:49 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c1bfb297-0041-40cb-be72-3542ec469ca7 tempest-VolumesActionsTest-450281722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-70c75218-7ac1-4117-b9fb-904097d40912" returned: 0 in 0.840s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c1bfb297-0041-40cb-be72-3542ec469ca7 tempest-VolumesActionsTest-450281722 None] Lock "cinder-quobyte-70c75218-7ac1-4117-b9fb-904097d40912" released by "delete_volume" :: held 2.122s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:49 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-c1bfb297-0041-40cb-be72-3542ec469ca7 tempest-VolumesActionsTest-450281722 None] Created reservations ['db6e6e9a-3a2c-40b5-8e2a-1e0021b26852', '335a94e4-fa40-46c7-9f0f-583857d0d427', '637df718-0a08-4b94-be98-84902af0a340', '30be8538-1ea2-478f-bc4c-923092080061'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:51:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c1bfb297-0041-40cb-be72-3542ec469ca7 tempest-VolumesActionsTest-450281722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c1bfb297-0041-40cb-be72-3542ec469ca7 tempest-VolumesActionsTest-450281722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:49 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c1bfb297-0041-40cb-be72-3542ec469ca7 tempest-VolumesActionsTest-450281722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:49 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c1bfb297-0041-40cb-be72-3542ec469ca7 tempest-VolumesActionsTest-450281722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c1bfb297-0041-40cb-be72-3542ec469ca7 tempest-VolumesActionsTest-450281722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c1bfb297-0041-40cb-be72-3542ec469ca7 tempest-VolumesActionsTest-450281722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:49 devstack sudo[104238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:51:49 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:50 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c1bfb297-0041-40cb-be72-3542ec469ca7 tempest-VolumesActionsTest-450281722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.039s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:50 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-c1bfb297-0041-40cb-be72-3542ec469ca7 tempest-VolumesActionsTest-450281722 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:51:50 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-c1bfb297-0041-40cb-be72-3542ec469ca7 tempest-VolumesActionsTest-450281722 None] Deleted volume successfully.
Jun 26 05:51:50 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c1bfb297-0041-40cb-be72-3542ec469ca7 tempest-VolumesActionsTest-450281722 None] Lock "cinder-70c75218-7ac1-4117-b9fb-904097d40912-delete_volume" released by "delete_volume" :: held 3.524s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Flow 'volume_create_manager' (196b37d2-92f4-4cc9-bb8f-7783dae5ade1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01ad7e5-ef84-4365-a6e8-1ede5f0772e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01ad7e5-ef84-4365-a6e8-1ede5f0772e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1874344244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9cf323-d8f1-483e-b650-8c1f28edbb69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1d1466f1d94f7e91947be8ada55971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:51:51Z,use_quota=True,user_id='5f41366cccb84013b42c944c6d4cc19d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97d47ea-4bb2-4bfe-8e28-a1283a291e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97d47ea-4bb2-4bfe-8e28-a1283a291e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3304056-bffa-4edf-bd65-f8debd8e9e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3304056-bffa-4edf-bd65-f8debd8e9e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f9cf323-d8f1-483e-b650-8c1f28edbb69', 'volume_name': 'volume-3f9cf323-d8f1-483e-b650-8c1f28edbb69', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4f3fbe-84d9-4b7a-b4fc-7fd190565170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4f3fbe-84d9-4b7a-b4fc-7fd190565170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07384611-2d2e-4ff1-9adf-a98d9e1f4526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:51 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Volume 3f9cf323-d8f1-483e-b650-8c1f28edbb69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f9cf323-d8f1-483e-b650-8c1f28edbb69', 'volume_size': 1}
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1874344244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9cf323-d8f1-483e-b650-8c1f28edbb69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1d1466f1d94f7e91947be8ada55971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:51:51Z,use_quota=True,user_id='5f41366cccb84013b42c944c6d4cc19d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Creating volume 3f9cf323-d8f1-483e-b650-8c1f28edbb69 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:51:51 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:51:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f9cf323-d8f1-483e-b650-8c1f28edbb69 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:51 devstack sudo[104264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f9cf323-d8f1-483e-b650-8c1f28edbb69 1073741824
Jun 26 05:51:51 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:52 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f9cf323-d8f1-483e-b650-8c1f28edbb69 1073741824" returned: 0 in 1.177s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f9cf323-d8f1-483e-b650-8c1f28edbb69 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:52 devstack sudo[104272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f9cf323-d8f1-483e-b650-8c1f28edbb69
Jun 26 05:51:52 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:53 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f9cf323-d8f1-483e-b650-8c1f28edbb69" returned: 0 in 0.790s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:53 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:51:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07384611-2d2e-4ff1-9adf-a98d9e1f4526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f9cf323-d8f1-483e-b650-8c1f28edbb69', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60984bb0-26c8-4c59-ac05-b7708ffc147d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:53 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Volume volume-3f9cf323-d8f1-483e-b650-8c1f28edbb69 (3f9cf323-d8f1-483e-b650-8c1f28edbb69): created successfully
Jun 26 05:51:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60984bb0-26c8-4c59-ac05-b7708ffc147d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Flow 'volume_create_manager' (196b37d2-92f4-4cc9-bb8f-7783dae5ade1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:51:53 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e7c6abcf-6811-4e1e-865f-17ccb03ae17c tempest-VolumesActionsTest-1876783963 None] Created volume successfully.
Jun 26 05:51:54 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-58f3330e-09de-4e7f-b694-c8f14337604f req-77ebcd0b-d8e1-4b03-921a-04e12b3e4e29 tempest-TestInstancesWithCinderVolumes-1417758814 None] Terminate volume connection completed successfully.
Jun 26 05:51:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-58f3330e-09de-4e7f-b694-c8f14337604f req-77ebcd0b-d8e1-4b03-921a-04e12b3e4e29 tempest-TestInstancesWithCinderVolumes-1417758814 None] Deleting attachment 1180c07c-ac5e-4734-b786-b4d25acf075a. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 05:51:54 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-91911065-9805-41e1-a3b6-10268c1ac0ad tempest-VolumesActionsTest-450281722 None] Acquiring lock "cinder-3f9cf323-d8f1-483e-b650-8c1f28edbb69-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:54 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-91911065-9805-41e1-a3b6-10268c1ac0ad tempest-VolumesActionsTest-450281722 None] Lock "cinder-3f9cf323-d8f1-483e-b650-8c1f28edbb69-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:54 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-91911065-9805-41e1-a3b6-10268c1ac0ad tempest-VolumesActionsTest-450281722 None] Acquiring lock "cinder-quobyte-3f9cf323-d8f1-483e-b650-8c1f28edbb69" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-91911065-9805-41e1-a3b6-10268c1ac0ad tempest-VolumesActionsTest-450281722 None] Lock "cinder-quobyte-3f9cf323-d8f1-483e-b650-8c1f28edbb69" acquired by "delete_volume" :: waited 0.035s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:55 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0fb8a7-58ea-4f4c-bf2b-d0aa83835cb2]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:51:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-91911065-9805-41e1-a3b6-10268c1ac0ad tempest-VolumesActionsTest-450281722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f9cf323-d8f1-483e-b650-8c1f28edbb69 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:55 devstack sudo[104285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f9cf323-d8f1-483e-b650-8c1f28edbb69
Jun 26 05:51:55 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] Acquiring lock "cinder-aae51433-0a2e-4458-86ed-5f137f9e6cfd-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "cinder-aae51433-0a2e-4458-86ed-5f137f9e6cfd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] Acquiring lock "cinder-quobyte-aae51433-0a2e-4458-86ed-5f137f9e6cfd" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:51:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "cinder-quobyte-aae51433-0a2e-4458-86ed-5f137f9e6cfd" acquired by "delete_volume" :: waited 0.027s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:51:55 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[425a605f-6a45-41c5-bdad-4e1a00ae856b]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:51:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aae51433-0a2e-4458-86ed-5f137f9e6cfd {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:55 devstack sudo[104294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aae51433-0a2e-4458-86ed-5f137f9e6cfd
Jun 26 05:51:55 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:55 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-91911065-9805-41e1-a3b6-10268c1ac0ad tempest-VolumesActionsTest-450281722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f9cf323-d8f1-483e-b650-8c1f28edbb69" returned: 0 in 0.902s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-91911065-9805-41e1-a3b6-10268c1ac0ad tempest-VolumesActionsTest-450281722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f9cf323-d8f1-483e-b650-8c1f28edbb69 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:56 devstack sudo[104296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f9cf323-d8f1-483e-b650-8c1f28edbb69
Jun 26 05:51:56 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:56 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-91911065-9805-41e1-a3b6-10268c1ac0ad tempest-VolumesActionsTest-450281722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3f9cf323-d8f1-483e-b650-8c1f28edbb69" returned: 0 in 0.856s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:56 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-91911065-9805-41e1-a3b6-10268c1ac0ad tempest-VolumesActionsTest-450281722 None] Lock "cinder-quobyte-3f9cf323-d8f1-483e-b650-8c1f28edbb69" released by "delete_volume" :: held 1.831s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:57 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:57 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-91911065-9805-41e1-a3b6-10268c1ac0ad tempest-VolumesActionsTest-450281722 None] Created reservations ['a89f6403-7040-4f66-a8b7-71af252e05fd', '29164424-bf69-427f-8ed1-bddd761326b7', '47a9caf9-13ae-420d-b8df-bcbe903fbb99', '23aa5de8-1c65-4b52-9ba9-f2d57831d451'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:51:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aae51433-0a2e-4458-86ed-5f137f9e6cfd" returned: 0 in 1.177s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aae51433-0a2e-4458-86ed-5f137f9e6cfd {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:57 devstack sudo[104302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aae51433-0a2e-4458-86ed-5f137f9e6cfd
Jun 26 05:51:57 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-91911065-9805-41e1-a3b6-10268c1ac0ad tempest-VolumesActionsTest-450281722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-91911065-9805-41e1-a3b6-10268c1ac0ad tempest-VolumesActionsTest-450281722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-91911065-9805-41e1-a3b6-10268c1ac0ad tempest-VolumesActionsTest-450281722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-91911065-9805-41e1-a3b6-10268c1ac0ad tempest-VolumesActionsTest-450281722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-91911065-9805-41e1-a3b6-10268c1ac0ad tempest-VolumesActionsTest-450281722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-91911065-9805-41e1-a3b6-10268c1ac0ad tempest-VolumesActionsTest-450281722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:57 devstack sudo[104304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:51:57 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Flow 'volume_create_manager' (00e1c2f1-badb-42b4-8682-afb158d16164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd41174b-c64a-4c0d-915c-a162d3f95849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd41174b-c64a-4c0d-915c-a162d3f95849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-984125932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1d1466f1d94f7e91947be8ada55971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:51:58Z,use_quota=True,user_id='5f41366cccb84013b42c944c6d4cc19d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1688b15-6598-4e0b-a953-60b0fb2d5f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1688b15-6598-4e0b-a953-60b0fb2d5f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec497471-96e2-4a7f-bcda-8bb0c24a75ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec497471-96e2-4a7f-bcda-8bb0c24a75ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b', 'volume_name': 'volume-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:58 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1992fa9-4683-4b47-ad4d-da7cb395c974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1992fa9-4683-4b47-ad4d-da7cb395c974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (092482de-f317-41de-864f-70c5fc2f6691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:51:58 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Volume ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b', 'volume_size': 1}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-984125932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1d1466f1d94f7e91947be8ada55971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:51:58Z,use_quota=True,user_id='5f41366cccb84013b42c944c6d4cc19d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Creating volume ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:51:58 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-aae51433-0a2e-4458-86ed-5f137f9e6cfd" returned: 0 in 1.224s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "cinder-quobyte-aae51433-0a2e-4458-86ed-5f137f9e6cfd" released by "delete_volume" :: held 2.461s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:58 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:58 devstack sudo[104308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b 1073741824
Jun 26 05:51:58 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-91911065-9805-41e1-a3b6-10268c1ac0ad tempest-VolumesActionsTest-450281722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.149s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-91911065-9805-41e1-a3b6-10268c1ac0ad tempest-VolumesActionsTest-450281722 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:51:58 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-91911065-9805-41e1-a3b6-10268c1ac0ad tempest-VolumesActionsTest-450281722 None] Deleted volume successfully.
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-91911065-9805-41e1-a3b6-10268c1ac0ad tempest-VolumesActionsTest-450281722 None] Lock "cinder-3f9cf323-d8f1-483e-b650-8c1f28edbb69-delete_volume" released by "delete_volume" :: held 3.468s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:58 devstack cinder-volume[93708]: WARNING cinder.quota [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-365588110-1815621577 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-365588110-1815621577, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:51:58 devstack cinder-volume[93708]: WARNING cinder.quota [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-365588110-1815621577 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-365588110-1815621577, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] Created reservations ['469f57cb-25f4-4ced-9ce0-114448796011', 'd5ed5b9e-d7f6-4b0d-a503-9ee849a172ce', '10495632-5e75-41ce-89c6-1ad797d76318', '8fc49b3c-bdc3-4ceb-b6b9-41082eca9692'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:51:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:58 devstack sudo[104313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:51:58 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:51:59 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.065s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:59 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:51:59 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] Deleted volume successfully.
Jun 26 05:51:59 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e172edc1-0c29-4c3e-88ec-1f6d41007531 tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "cinder-aae51433-0a2e-4458-86ed-5f137f9e6cfd-delete_volume" released by "delete_volume" :: held 3.933s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:51:59 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root
Jun 26 05:51:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b 1073741824" returned: 0 in 1.528s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:51:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:51:59 devstack sudo[104341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b
Jun 26 05:51:59 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:00 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b" returned: 0 in 1.087s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:00 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] <== create_volume: return (2717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:52:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.719s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (092482de-f317-41de-864f-70c5fc2f6691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb340207-42f3-493d-9c85-36d0fea18571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:00 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Volume volume-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b (ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b): created successfully
Jun 26 05:52:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb340207-42f3-493d-9c85-36d0fea18571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Flow 'volume_create_manager' (00e1c2f1-badb-42b4-8682-afb158d16164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:52:01 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-8c3f25af-5b64-48d0-a817-b8a849feceb0 tempest-VolumesActionsTest-1876783963 None] Created volume successfully.
Jun 26 05:52:02 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-4104ed84-672b-4f1c-8485-a342519d4d30 req-6c5df807-6f12-4b7d-aab8-d35188b4d7de tempest-TestInstancesWithCinderVolumes-1417758814 None] Terminate volume connection completed successfully.
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-4104ed84-672b-4f1c-8485-a342519d4d30 req-6c5df807-6f12-4b7d-aab8-d35188b4d7de tempest-TestInstancesWithCinderVolumes-1417758814 None] Deleting attachment c2cab775-b7bd-47cd-8fdd-4d9df4ebfe25. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Flow 'volume_create_manager' (094c65da-e9b9-418b-8a63-e38e024394a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67bfb708-ed23-41e2-ba12-88c6e125144d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67bfb708-ed23-41e2-ba12-88c6e125144d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-269455669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3f10f9-4232-4222-8501-ff5bc07be04e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927dbdce0f354b5f9b88fa12fd57178f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:52:02Z,use_quota=True,user_id='060418eb63ba43eb8c4050c0f3bf3c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42998e56-dad2-49ca-81b2-98bca1bd42c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42998e56-dad2-49ca-81b2-98bca1bd42c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738c42d7-0423-4277-8604-022548ac85f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738c42d7-0423-4277-8604-022548ac85f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a3f10f9-4232-4222-8501-ff5bc07be04e', 'volume_name': 'volume-1a3f10f9-4232-4222-8501-ff5bc07be04e', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d07cdc3-2c7b-420a-829c-83089e176115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d07cdc3-2c7b-420a-829c-83089e176115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e013faae-3f67-4dc6-9a1b-743b6647157e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:02 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Volume 1a3f10f9-4232-4222-8501-ff5bc07be04e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a3f10f9-4232-4222-8501-ff5bc07be04e', 'volume_size': 1}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-269455669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3f10f9-4232-4222-8501-ff5bc07be04e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927dbdce0f354b5f9b88fa12fd57178f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:52:02Z,use_quota=True,user_id='060418eb63ba43eb8c4050c0f3bf3c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Creating volume 1a3f10f9-4232-4222-8501-ff5bc07be04e {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:52:02 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:02 devstack sudo[104370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e 1073741824
Jun 26 05:52:02 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c1d0ba70-cf06-4a22-8e62-83292dccd228 tempest-VolumesActionsTest-1876783963 None] Acquiring lock "cinder-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c1d0ba70-cf06-4a22-8e62-83292dccd228 tempest-VolumesActionsTest-1876783963 None] Lock "cinder-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c1d0ba70-cf06-4a22-8e62-83292dccd228 tempest-VolumesActionsTest-1876783963 None] Acquiring lock "cinder-quobyte-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c1d0ba70-cf06-4a22-8e62-83292dccd228 tempest-VolumesActionsTest-1876783963 None] Lock "cinder-quobyte-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b" acquired by "delete_volume" :: waited 0.035s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[159d77f0-4679-4fde-b569-e1d25234e550]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c1d0ba70-cf06-4a22-8e62-83292dccd228 tempest-VolumesActionsTest-1876783963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:02 devstack sudo[104372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b
Jun 26 05:52:02 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:03 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e 1073741824" returned: 0 in 0.968s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:03 devstack sudo[104381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e
Jun 26 05:52:03 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:03 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c1d0ba70-cf06-4a22-8e62-83292dccd228 tempest-VolumesActionsTest-1876783963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b" returned: 0 in 0.877s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c1d0ba70-cf06-4a22-8e62-83292dccd228 tempest-VolumesActionsTest-1876783963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:03 devstack sudo[104383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b
Jun 26 05:52:03 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:03 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] Acquiring lock "cinder-92e06ab3-f7f0-4949-b79a-81bb173f2c06-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:52:03 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "cinder-92e06ab3-f7f0-4949-b79a-81bb173f2c06-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:52:03 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] Acquiring lock "cinder-quobyte-92e06ab3-f7f0-4949-b79a-81bb173f2c06" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:52:03 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "cinder-quobyte-92e06ab3-f7f0-4949-b79a-81bb173f2c06" acquired by "delete_volume" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:52:03 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[455a1246-5b90-4ade-8809-e9b647ed7eb3]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-92e06ab3-f7f0-4949-b79a-81bb173f2c06 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:04 devstack sudo[104385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-92e06ab3-f7f0-4949-b79a-81bb173f2c06
Jun 26 05:52:04 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:04 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e" returned: 0 in 0.761s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:04 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:52:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:04 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e013faae-3f67-4dc6-9a1b-743b6647157e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a3f10f9-4232-4222-8501-ff5bc07be04e', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:04 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b833dd-1819-4610-a076-2b259bf24077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:04 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Volume volume-1a3f10f9-4232-4222-8501-ff5bc07be04e (1a3f10f9-4232-4222-8501-ff5bc07be04e): created successfully
Jun 26 05:52:04 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b833dd-1819-4610-a076-2b259bf24077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:04 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Flow 'volume_create_manager' (094c65da-e9b9-418b-8a63-e38e024394a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:52:04 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-a24efaea-0bf6-47e4-95e4-d73b7054a156 tempest-VolumesSnapshotTestJSON-899172881 None] Created volume successfully.
Jun 26 05:52:04 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c1d0ba70-cf06-4a22-8e62-83292dccd228 tempest-VolumesActionsTest-1876783963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b" returned: 0 in 0.860s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:04 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c1d0ba70-cf06-4a22-8e62-83292dccd228 tempest-VolumesActionsTest-1876783963 None] Lock "cinder-quobyte-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b" released by "delete_volume" :: held 1.793s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:52:04 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-c1d0ba70-cf06-4a22-8e62-83292dccd228 tempest-VolumesActionsTest-1876783963 None] Created reservations ['4fa38bd4-578d-4567-a213-269f40e21cdb', '2925f8a4-6250-4577-a487-06a35ddfcfae', '044928a8-3965-486f-9452-cc966bbc8dc5', '477a83b5-4a97-46e2-a3d7-b683a95af876'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:52:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c1d0ba70-cf06-4a22-8e62-83292dccd228 tempest-VolumesActionsTest-1876783963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c1d0ba70-cf06-4a22-8e62-83292dccd228 tempest-VolumesActionsTest-1876783963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:04 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c1d0ba70-cf06-4a22-8e62-83292dccd228 tempest-VolumesActionsTest-1876783963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:52:04 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c1d0ba70-cf06-4a22-8e62-83292dccd228 tempest-VolumesActionsTest-1876783963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:52:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c1d0ba70-cf06-4a22-8e62-83292dccd228 tempest-VolumesActionsTest-1876783963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c1d0ba70-cf06-4a22-8e62-83292dccd228 tempest-VolumesActionsTest-1876783963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:04 devstack sudo[104391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:52:04 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:04 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-92e06ab3-f7f0-4949-b79a-81bb173f2c06" returned: 0 in 0.987s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-92e06ab3-f7f0-4949-b79a-81bb173f2c06 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:04 devstack sudo[104396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-92e06ab3-f7f0-4949-b79a-81bb173f2c06
Jun 26 05:52:04 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:05 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c1d0ba70-cf06-4a22-8e62-83292dccd228 tempest-VolumesActionsTest-1876783963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.862s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:05 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-c1d0ba70-cf06-4a22-8e62-83292dccd228 tempest-VolumesActionsTest-1876783963 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:52:05 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-c1d0ba70-cf06-4a22-8e62-83292dccd228 tempest-VolumesActionsTest-1876783963 None] Deleted volume successfully.
Jun 26 05:52:05 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c1d0ba70-cf06-4a22-8e62-83292dccd228 tempest-VolumesActionsTest-1876783963 None] Lock "cinder-ae0c67a3-9d70-4bb0-8ac8-42acbed0f43b-delete_volume" released by "delete_volume" :: held 2.956s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:52:05 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-92e06ab3-f7f0-4949-b79a-81bb173f2c06" returned: 0 in 0.997s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-da52d13d-ccdc-43b8-9e24-b6193f0ccc17 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-da52d13d-ccdc-43b8-9e24-b6193f0ccc17 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:05 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "cinder-quobyte-92e06ab3-f7f0-4949-b79a-81bb173f2c06" released by "delete_volume" :: held 2.051s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:52:05 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-da52d13d-ccdc-43b8-9e24-b6193f0ccc17 tempest-VolumesSnapshotTestJSON-899172881 None] Creating offline snapshot e6522461-d86d-40ce-8366-9aad83b3181c of volume 1a3f10f9-4232-4222-8501-ff5bc07be04e {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:52:05 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d4b4dd-1fd8-4eb8-a676-914c1644a885]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-da52d13d-ccdc-43b8-9e24-b6193f0ccc17 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:05 devstack cinder-volume[93708]: WARNING cinder.quota [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1843371348-1788074597 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1843371348-1788074597, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:52:05 devstack cinder-volume[93708]: WARNING cinder.quota [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1843371348-1788074597 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1843371348-1788074597, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:52:06 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] Created reservations ['2bad94cf-cdb9-4571-a6a5-18abc919af7a', 'd4cdaee5-8fb8-478d-a775-00f405a0a920', '30e4b2a8-3c42-4cc3-9df3-cdcfb02e653c', '58dda167-e159-4f10-84bc-d6d149460aa7'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:52:06 devstack sudo[104404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e
Jun 26 05:52:06 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:52:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:52:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:06 devstack sudo[104406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:52:06 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:06 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.862s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:06 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:52:07 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] Deleted volume successfully.
Jun 26 05:52:07 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-da52d13d-ccdc-43b8-9e24-b6193f0ccc17 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e" returned: 0 in 1.097s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-da52d13d-ccdc-43b8-9e24-b6193f0ccc17 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.e6522461-d86d-40ce-8366-9aad83b3181c 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:07 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e687c9ce-bab2-4266-bf7b-57e1f35eb6e0 tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "cinder-92e06ab3-f7f0-4949-b79a-81bb173f2c06-delete_volume" released by "delete_volume" :: held 3.287s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:52:07 devstack sudo[104413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.e6522461-d86d-40ce-8366-9aad83b3181c 1G
Jun 26 05:52:07 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:08 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-da52d13d-ccdc-43b8-9e24-b6193f0ccc17 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.e6522461-d86d-40ce-8366-9aad83b3181c 1G" returned: 0 in 1.033s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-da52d13d-ccdc-43b8-9e24-b6193f0ccc17 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a3f10f9-4232-4222-8501-ff5bc07be04e -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.e6522461-d86d-40ce-8366-9aad83b3181c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:08 devstack sudo[104437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a3f10f9-4232-4222-8501-ff5bc07be04e -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.e6522461-d86d-40ce-8366-9aad83b3181c
Jun 26 05:52:08 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:09 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-da52d13d-ccdc-43b8-9e24-b6193f0ccc17 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a3f10f9-4232-4222-8501-ff5bc07be04e -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.e6522461-d86d-40ce-8366-9aad83b3181c" returned: 0 in 1.483s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:09 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-da52d13d-ccdc-43b8-9e24-b6193f0ccc17 tempest-VolumesSnapshotTestJSON-899172881 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.e6522461-d86d-40ce-8366-9aad83b3181c is being set with open permissions: ugo+rw
Jun 26 05:52:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-da52d13d-ccdc-43b8-9e24-b6193f0ccc17 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.e6522461-d86d-40ce-8366-9aad83b3181c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:09 devstack sudo[104536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.e6522461-d86d-40ce-8366-9aad83b3181c
Jun 26 05:52:09 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:52:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:52:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:52:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:10 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-da52d13d-ccdc-43b8-9e24-b6193f0ccc17 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.e6522461-d86d-40ce-8366-9aad83b3181c" returned: 0 in 1.210s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:10 devstack sudo[104554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:52:10 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-da52d13d-ccdc-43b8-9e24-b6193f0ccc17 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:10 devstack sudo[104556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.info
Jun 26 05:52:10 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:12 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.706s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:12 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:52:12 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:52:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 28 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:52:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>, <Thread(tpool_thread_0, started daemon 124035494721216)>, <Thread(tpool_thread_1, started daemon 124035486328512)>, <Thread(tpool_thread_2, started daemon 124035477919424)>, <Thread(tpool_thread_3, started daemon 124035469510336)>, <Thread(tpool_thread_4, started daemon 124035461101248)>, <Thread(tpool_thread_5, started daemon 124035452692160)>, <Thread(tpool_thread_6, started daemon 124035444283072)>, <Thread(tpool_thread_7, started daemon 124035435873984)>, <Thread(tpool_thread_8, started daemon 124035427464896)>, <Thread(tpool_thread_9, started daemon 124035419055808)>, <Thread(tpool_thread_10, started daemon 124035410646720)>, <Thread(tpool_thread_11, started daemon 124035402237632)>, <Thread(tpool_thread_12, started daemon 124035393828544)>, <Thread(tpool_thread_13, started daemon 124035385419456)>, <Thread(tpool_thread_14, started daemon 124035377010368)>, <Thread(tpool_thread_15, started daemon 124035368601280)>, <Thread(tpool_thread_16, started daemon 124035360192192)>, <Thread(tpool_thread_17, started daemon 124035351783104)>, <Thread(tpool_thread_18, started daemon 124035343374016)>, <Thread(tpool_thread_19, started daemon 124035334964928)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:52:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-da52d13d-ccdc-43b8-9e24-b6193f0ccc17 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.info" returned: 0 in 1.680s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:12 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-da52d13d-ccdc-43b8-9e24-b6193f0ccc17 tempest-VolumesSnapshotTestJSON-899172881 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.info is being set with open permissions: ugo+rw
Jun 26 05:52:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-da52d13d-ccdc-43b8-9e24-b6193f0ccc17 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:12 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:12 devstack sudo[104565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.info
Jun 26 05:52:12 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:12 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-a96ed0c9-d20f-4b8a-8b21-e3179db2b455 req-0af65b19-bda2-4d46-9be3-a3cd2aad6d2a tempest-TestInstancesWithCinderVolumes-1417758814 None] Terminate volume connection completed successfully.
Jun 26 05:52:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-a96ed0c9-d20f-4b8a-8b21-e3179db2b455 req-0af65b19-bda2-4d46-9be3-a3cd2aad6d2a tempest-TestInstancesWithCinderVolumes-1417758814 None] Deleting attachment e470afb4-f83a-42cb-aa92-938acee1835a. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 05:52:13 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-da52d13d-ccdc-43b8-9e24-b6193f0ccc17 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.info" returned: 0 in 1.073s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-da52d13d-ccdc-43b8-9e24-b6193f0ccc17 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.773s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:13 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-da52d13d-ccdc-43b8-9e24-b6193f0ccc17 tempest-VolumesSnapshotTestJSON-899172881 None] Create snapshot completed successfully
Jun 26 05:52:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-e6522461-d86d-40ce-8366-9aad83b3181c-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:52:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-e6522461-d86d-40ce-8366-9aad83b3181c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:52:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-quobyte-1a3f10f9-4232-4222-8501-ff5bc07be04e" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:52:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-1a3f10f9-4232-4222-8501-ff5bc07be04e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:52:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-quobyte-e6522461-d86d-40ce-8366-9aad83b3181c" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:52:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-e6522461-d86d-40ce-8366-9aad83b3181c" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:52:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] Deleting offline snapshot e6522461-d86d-40ce-8366-9aad83b3181c of volume 1a3f10f9-4232-4222-8501-ff5bc07be04e {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:52:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] snapshot_file for this snap is: volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.e6522461-d86d-40ce-8366-9aad83b3181c {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:52:14 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[71316aa8-c1f2-46ef-a4b3-e21278e60dd7]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.e6522461-d86d-40ce-8366-9aad83b3181c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:15 devstack sudo[104572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.e6522461-d86d-40ce-8366-9aad83b3181c
Jun 26 05:52:15 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:15 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.e6522461-d86d-40ce-8366-9aad83b3181c" returned: 0 in 1.072s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a3f10f9-4232-4222-8501-ff5bc07be04e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:52:16 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[978becd7-10e1-438b-a1aa-210c58a6125a]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:16 devstack sudo[104577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e
Jun 26 05:52:16 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] Acquiring lock "cinder-daf45398-92a9-486c-a2be-cc4ce7aa44d5-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:52:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "cinder-daf45398-92a9-486c-a2be-cc4ce7aa44d5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:52:16 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:INSERT=32,cinder:UPDATE=145,cinder:SELECT=115,cinder:DELETE=12 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:52:17 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=152,cinder:SELECT=113,cinder:INSERT=35,cinder:DELETE=13 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:52:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] Acquiring lock "cinder-quobyte-daf45398-92a9-486c-a2be-cc4ce7aa44d5" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:52:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "cinder-quobyte-daf45398-92a9-486c-a2be-cc4ce7aa44d5" acquired by "delete_volume" :: waited 0.042s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:52:17 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[19aa4bee-92e3-426f-b641-45cc753a3a63]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:17 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e" returned: 0 in 1.229s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.e6522461-d86d-40ce-8366-9aad83b3181c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:17 devstack sudo[104583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.e6522461-d86d-40ce-8366-9aad83b3181c
Jun 26 05:52:17 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:17 devstack sudo[104582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5
Jun 26 05:52:17 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:18 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5" returned: 0 in 1.104s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:18 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.e6522461-d86d-40ce-8366-9aad83b3181c" returned: 0 in 1.133s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.e6522461-d86d-40ce-8366-9aad83b3181c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:18 devstack sudo[104594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.e6522461-d86d-40ce-8366-9aad83b3181c
Jun 26 05:52:18 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:18 devstack sudo[104593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5
Jun 26 05:52:18 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:19 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e.e6522461-d86d-40ce-8366-9aad83b3181c" returned: 0 in 0.834s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-e6522461-d86d-40ce-8366-9aad83b3181c" released by "_delete_snapshot" :: held 4.473s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:52:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-1a3f10f9-4232-4222-8501-ff5bc07be04e" released by "delete_snapshot" :: held 4.526s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:52:19 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5" returned: 1 in 1.097s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 05:52:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:19 devstack sudo[104601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5
Jun 26 05:52:19 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:19 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] Created reservations ['3528c088-b28f-474e-b451-85fc596f69d6', 'd29589f3-7b66-4c37-99ce-7e9b339e7dbb', '680dd7aa-4abc-4e1e-bc19-0e24d2a9ce14', '612a45ae-a007-4438-8592-d270f3cf4917'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:52:19 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] Delete snapshot completed successfully.
Jun 26 05:52:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dbd67910-797f-4116-8c20-0b89b6a4e317 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-e6522461-d86d-40ce-8366-9aad83b3181c-delete_snapshot" released by "delete_snapshot" :: held 4.787s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:52:20 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-daf45398-92a9-486c-a2be-cc4ce7aa44d5" returned: 0 in 0.684s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:20 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "cinder-quobyte-daf45398-92a9-486c-a2be-cc4ce7aa44d5" released by "delete_volume" :: held 3.006s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:52:20 devstack cinder-volume[93708]: WARNING cinder.quota [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1555715196-497953938 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1555715196-497953938, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:52:20 devstack cinder-volume[93708]: WARNING cinder.quota [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1555715196-497953938 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1555715196-497953938, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:52:20 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] Created reservations ['96f54758-5552-4efa-95de-e2f7a73cf047', '80a170d6-e917-46aa-9f44-9aff4ea06336', '021603b2-a3c9-44d7-be3c-55695a3e2e85', '0e325446-9b1a-45bd-9807-6d768ecf6101'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:52:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:20 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:52:20 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:52:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:20 devstack sudo[104604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:52:20 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Flow 'volume_create_manager' (8d3df2a8-adc3-4de4-82e1-b927c0b724de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3738ca88-c19c-46cf-aa24-d2ca7a6f93e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3738ca88-c19c-46cf-aa24-d2ca7a6f93e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-974638830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d293eef-030f-4cc5-a3f9-b3d832182cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927dbdce0f354b5f9b88fa12fd57178f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:52:21Z,use_quota=True,user_id='060418eb63ba43eb8c4050c0f3bf3c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f0ea4c-a56e-4a16-9099-dd56b7f6c5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f0ea4c-a56e-4a16-9099-dd56b7f6c5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295025df-a7d8-4871-99c0-bb6372c1274f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295025df-a7d8-4871-99c0-bb6372c1274f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d293eef-030f-4cc5-a3f9-b3d832182cab', 'volume_name': 'volume-3d293eef-030f-4cc5-a3f9-b3d832182cab', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309d3eac-de77-4f7c-adbb-f1729ae26810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309d3eac-de77-4f7c-adbb-f1729ae26810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7fc4db6-048f-49d5-aea7-ac77e346b901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:21 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Volume 3d293eef-030f-4cc5-a3f9-b3d832182cab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d293eef-030f-4cc5-a3f9-b3d832182cab', 'volume_size': 1}
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-974638830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d293eef-030f-4cc5-a3f9-b3d832182cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927dbdce0f354b5f9b88fa12fd57178f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:52:21Z,use_quota=True,user_id='060418eb63ba43eb8c4050c0f3bf3c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Creating volume 3d293eef-030f-4cc5-a3f9-b3d832182cab {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:52:21 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:21 devstack sudo[104607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab 1073741824
Jun 26 05:52:21 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:21 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.117s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:52:21 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] Deleted volume successfully.
Jun 26 05:52:21 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-27d8c1a3-e0be-4c97-a5d8-7dca9a9010eb tempest-TestInstancesWithCinderVolumes-1417758814 None] Lock "cinder-daf45398-92a9-486c-a2be-cc4ce7aa44d5-delete_volume" released by "delete_volume" :: held 4.485s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:52:22 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab 1073741824" returned: 0 in 1.211s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:22 devstack sudo[104613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab
Jun 26 05:52:22 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:22 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:52:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Flow 'volume_create_manager' (f6120e12-36a8-43c4-9d15-a4afeeb3ec9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:52:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3368b5-8a4b-478a-ac8a-2e44a745c75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3368b5-8a4b-478a-ac8a-2e44a745c75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-212003312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f17bb1f-3f3d-4c8c-8861-5e5d884cd124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2837ac8ab854e58bc7f85e5557a9ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:52:23Z,use_quota=True,user_id='56679cdca79b41fe8059ff01e95b787b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77798d99-de6b-438b-a381-2a5dbc2244f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77798d99-de6b-438b-a381-2a5dbc2244f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50e35c2-84f1-4d9c-b742-2a4fef2e419a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:23 devstack cinder-volume[93708]: DEBUG cinder.image.glance [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Creating Keystone auth plugin from conf {{(pid=93708) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 26 05:52:23 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab" returned: 0 in 0.976s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:23 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] <== create_volume: return (2259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:52:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.262s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50e35c2-84f1-4d9c-b742-2a4fef2e419a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5f17bb1f-3f3d-4c8c-8861-5e5d884cd124', 'volume_name': 'volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124', 'volume_size': 1, 'image_id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '672660d1b01a45828d72fce38b12f1f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'created_at': datetime.datetime(2026, 6, 26, 3, 35, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 3, 35, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfc393ae-7412-4258-bda5-dc0a6732fb07/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf43a5b710>}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db517c6-a562-46a5-8453-8b15ca2a9cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db517c6-a562-46a5-8453-8b15ca2a9cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b0b50b-2c91-4810-babe-1640975c1995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:23 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Volume 5f17bb1f-3f3d-4c8c-8861-5e5d884cd124: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124', 'volume_size': 1, 'image_id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '672660d1b01a45828d72fce38b12f1f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'created_at': datetime.datetime(2026, 6, 26, 3, 35, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 3, 35, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfc393ae-7412-4258-bda5-dc0a6732fb07/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf43a5b710>}
Jun 26 05:52:23 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Trying to clone 5f17bb1f-3f3d-4c8c-8861-5e5d884cd124 from image dfc393ae-7412-4258-bda5-dc0a6732fb07 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}]). {{(pid=93708) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 26 05:52:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7fc4db6-048f-49d5-aea7-ac77e346b901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d293eef-030f-4cc5-a3f9-b3d832182cab', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b940f862-4ee6-4ae5-a794-dbfc84c80c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:23 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Volume volume-3d293eef-030f-4cc5-a3f9-b3d832182cab (3d293eef-030f-4cc5-a3f9-b3d832182cab): created successfully
Jun 26 05:52:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b940f862-4ee6-4ae5-a794-dbfc84c80c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Flow 'volume_create_manager' (8d3df2a8-adc3-4de4-82e1-b927c0b724de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:52:23 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-eb1b2001-c62a-4d5b-9721-e4e27f71c805 tempest-VolumesSnapshotTestJSON-899172881 None] Created volume successfully.
Jun 26 05:52:23 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_6gc785m8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 26 05:52:23 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Image download 20.69 MB at 20.69 MB/s
Jun 26 05:52:23 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[972e8b46-7c88-4342-a0d7-194c7a00f29d]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_6gc785m8devstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:24 devstack sudo[104643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_6gc785m8devstack@QuobyteHD
Jun 26 05:52:24 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-78999ac8-2438-46e9-b494-a60b2994c34e tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-78999ac8-2438-46e9-b494-a60b2994c34e tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-78999ac8-2438-46e9-b494-a60b2994c34e tempest-VolumesSnapshotTestJSON-899172881 None] Creating offline snapshot 76c22ef0-c99c-4115-972d-d703ae320ed1 of volume 3d293eef-030f-4cc5-a3f9-b3d832182cab {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:52:24 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[797b5675-05d4-45e6-b684-45a6358ec568]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-78999ac8-2438-46e9-b494-a60b2994c34e tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:24 devstack sudo[104645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab
Jun 26 05:52:24 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:24 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_6gc785m8devstack@QuobyteHD" returned: 0 in 0.784s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:24 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Temporary image dfc393ae-7412-4258-bda5-dc0a6732fb07 is fetched for user 56679cdca79b41fe8059ff01e95b787b. {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 26 05:52:24 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ce36f3-81b0-4fb1-a5e3-b99e97d1efba]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_6gc785m8devstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:24 devstack sudo[104651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_6gc785m8devstack@QuobyteHD
Jun 26 05:52:24 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:25 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-78999ac8-2438-46e9-b494-a60b2994c34e tempest-VolumesSnapshotTestJSON-899172881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab" returned: 0 in 0.955s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-78999ac8-2438-46e9-b494-a60b2994c34e tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:25 devstack sudo[104670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1 1G
Jun 26 05:52:25 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:25 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_6gc785m8devstack@QuobyteHD" returned: 0 in 1.009s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:26 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-78999ac8-2438-46e9-b494-a60b2994c34e tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1 1G" returned: 0 in 0.934s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-78999ac8-2438-46e9-b494-a60b2994c34e tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d293eef-030f-4cc5-a3f9-b3d832182cab -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:26 devstack sudo[104703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d293eef-030f-4cc5-a3f9-b3d832182cab -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1
Jun 26 05:52:26 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:27 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-78999ac8-2438-46e9-b494-a60b2994c34e tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d293eef-030f-4cc5-a3f9-b3d832182cab -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1" returned: 0 in 0.711s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:27 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-78999ac8-2438-46e9-b494-a60b2994c34e tempest-VolumesSnapshotTestJSON-899172881 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1 is being set with open permissions: ugo+rw
Jun 26 05:52:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-78999ac8-2438-46e9-b494-a60b2994c34e tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:27 devstack sudo[104708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1
Jun 26 05:52:27 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:27 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-78999ac8-2438-46e9-b494-a60b2994c34e tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1" returned: 0 in 0.663s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-78999ac8-2438-46e9-b494-a60b2994c34e tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:27 devstack sudo[104712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.info
Jun 26 05:52:27 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:28 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-78999ac8-2438-46e9-b494-a60b2994c34e tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.info" returned: 0 in 0.663s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:28 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-78999ac8-2438-46e9-b494-a60b2994c34e tempest-VolumesSnapshotTestJSON-899172881 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.info is being set with open permissions: ugo+rw
Jun 26 05:52:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-78999ac8-2438-46e9-b494-a60b2994c34e tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:28 devstack sudo[104715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.info
Jun 26 05:52:28 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:29 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-78999ac8-2438-46e9-b494-a60b2994c34e tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.info" returned: 0 in 0.785s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-78999ac8-2438-46e9-b494-a60b2994c34e tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.801s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.413s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-212003312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f17bb1f-3f3d-4c8c-8861-5e5d884cd124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2837ac8ab854e58bc7f85e5557a9ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:52:23Z,use_quota=True,user_id='56679cdca79b41fe8059ff01e95b787b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:52:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Creating volume 5f17bb1f-3f3d-4c8c-8861-5e5d884cd124 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:52:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:52:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:52:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:52:29 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:52:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:29 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-78999ac8-2438-46e9-b494-a60b2994c34e tempest-VolumesSnapshotTestJSON-899172881 None] Create snapshot completed successfully
Jun 26 05:52:29 devstack sudo[104718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124 1073741824
Jun 26 05:52:29 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:30 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124 1073741824" returned: 0 in 1.074s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:30 devstack sudo[104725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124
Jun 26 05:52:30 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:30 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:52:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Flow 'volume_create_manager' (98f3e0cb-a1f0-4959-9022-9d6e3ee558fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:52:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae9c14f-2f22-4d9d-bd8a-347c47c34ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae9c14f-2f22-4d9d-bd8a-347c47c34ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-312480670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d123f624-4e9d-48e0-a765-8064176e547b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927dbdce0f354b5f9b88fa12fd57178f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:52:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=76c22ef0-c99c-4115-972d-d703ae320ed1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:52:30Z,use_quota=True,user_id='060418eb63ba43eb8c4050c0f3bf3c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e6f0ef-786f-4e6c-85d5-49e3b5b68a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e6f0ef-786f-4e6c-85d5-49e3b5b68a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc7cbac8-185a-4727-a581-b4d096e2bd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc7cbac8-185a-4727-a581-b4d096e2bd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd123f624-4e9d-48e0-a765-8064176e547b', 'volume_name': 'volume-d123f624-4e9d-48e0-a765-8064176e547b', 'volume_size': 2, 'snapshot_id': '76c22ef0-c99c-4115-972d-d703ae320ed1'}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5ad456-cd3d-49c9-a1dd-e7b9c7e85257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5ad456-cd3d-49c9-a1dd-e7b9c7e85257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199cb632-fd73-4940-a02e-ee9d654e24fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:30 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Volume d123f624-4e9d-48e0-a765-8064176e547b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d123f624-4e9d-48e0-a765-8064176e547b', 'volume_size': 2, 'snapshot_id': '76c22ef0-c99c-4115-972d-d703ae320ed1'}
Jun 26 05:52:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:31 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124" returned: 0 in 0.769s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.493s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-quobyte-76c22ef0-c99c-4115-972d-d703ae320ed1-d123f624-4e9d-48e0-a765-8064176e547b" by "_create_volume_from_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-76c22ef0-c99c-4115-972d-d703ae320ed1-d123f624-4e9d-48e0-a765-8064176e547b" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Creating volume d123f624-4e9d-48e0-a765-8064176e547b from snapshot 76c22ef0-c99c-4115-972d-d703ae320ed1 {{(pid=93708) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-quobyte-d123f624-4e9d-48e0-a765-8064176e547b" by "_copy_volume_from_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Attempting download of dfc393ae-7412-4258-bda5-dc0a6732fb07 ((None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}])) to volume 5f17bb1f-3f3d-4c8c-8861-5e5d884cd124. {{(pid=93708) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-d123f624-4e9d-48e0-a765-8064176e547b" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] snapshot: 76c22ef0-c99c-4115-972d-d703ae320ed1, volume: d123f624-4e9d-48e0-a765-8064176e547b,  {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[790dce8a-1d36-4f3f-a86f-abdc2f4bde71]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e619c3-7bcd-4746-a66e-7b410d026afa]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_e9ehype8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:31 devstack sudo[104728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1
Jun 26 05:52:31 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:31 devstack sudo[104729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_e9ehype8
Jun 26 05:52:31 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:32 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1" returned: 0 in 0.846s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:32 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d293eef-030f-4cc5-a3f9-b3d832182cab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:52:32 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 05:52:32 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Creating direct copy from snapshot {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 05:52:32 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:32 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[b898565b-258e-4eba-a295-601ae0916c84]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_e9ehype8" returned: 0 in 0.866s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_e9ehype8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:32 devstack sudo[104738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab
Jun 26 05:52:32 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:32 devstack sudo[104739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_e9ehype8
Jun 26 05:52:32 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:32 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_e9ehype8" returned: 1 in 0.791s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_e9ehype8' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 05:52:32 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedac418-233c-48b2-8eb1-ff6ecfadb883]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_6gc785m8devstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:32 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab" returned: 0 in 0.824s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:32 devstack cinder-volume[93708]: DEBUG cinder.utils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Path /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d123f624-4e9d-48e0-a765-8064176e547b not found in is_blk_device check {{(pid=93708) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 05:52:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d123f624-4e9d-48e0-a765-8064176e547b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:33 devstack sudo[104748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d123f624-4e9d-48e0-a765-8064176e547b
Jun 26 05:52:33 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:33 devstack sudo[104747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_6gc785m8devstack@QuobyteHD
Jun 26 05:52:33 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:33 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_6gc785m8devstack@QuobyteHD" returned: 0 in 0.882s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:33 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] dfc393ae-7412-4258-bda5-dc0a6732fb07 was qcow2, converting to raw {{(pid=93708) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 26 05:52:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_6gc785m8devstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:33 devstack sudo[104760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_6gc785m8devstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124
Jun 26 05:52:33 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:35 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:52:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Flow 'volume_create_manager' (2504c227-4ff1-4f50-be5e-2ec2b747fa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:52:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c3ef8b-20bf-46b6-97f4-bb2403908c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c3ef8b-20bf-46b6-97f4-bb2403908c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1346766625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de22793-7f50-4838-b4ef-eb44579f6810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84bed9b8b4ed475984b0aa2c9427d7ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:52:36Z,use_quota=True,user_id='e43a1f55a87541d885f132698206f785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (053c7791-5308-4514-a374-0a3da6f35803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (053c7791-5308-4514-a374-0a3da6f35803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fec87fa-7b63-4b08-b5fc-f84572266dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fec87fa-7b63-4b08-b5fc-f84572266dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1de22793-7f50-4838-b4ef-eb44579f6810', 'volume_name': 'volume-1de22793-7f50-4838-b4ef-eb44579f6810', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96281c7-a3d6-46bd-889c-281c856f1840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96281c7-a3d6-46bd-889c-281c856f1840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37e7824-e3b6-463e-b1e8-df4b19b3eeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:35 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Volume 1de22793-7f50-4838-b4ef-eb44579f6810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1de22793-7f50-4838-b4ef-eb44579f6810', 'volume_size': 1}
Jun 26 05:52:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:38 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_6gc785m8devstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124" returned: 0 in 4.625s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:38 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_6gc785m8devstack@QuobyteHD, size 112.00 MB, duration 4.63 sec, destination /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124 {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 05:52:38 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Converted 112.00 MB image at 24.18 MB/s
Jun 26 05:52:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:38 devstack sudo[104775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124 1G
Jun 26 05:52:38 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:39 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124 1G" returned: 0 in 1.055s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:39 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d123f624-4e9d-48e0-a765-8064176e547b" returned: 0 in 6.599s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:39 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[65519b20-a39e-492f-9836-85559e493eb6]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:39 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[4384a81a-6d5b-4ba1-9cea-ebf13adc878d]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:39 devstack sudo[104781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124
Jun 26 05:52:39 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:39 devstack sudo[104782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab
Jun 26 05:52:39 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:40 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124" returned: 0 in 0.788s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:40 devstack sudo[104789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124
Jun 26 05:52:40 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:40 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab" returned: 0 in 1.030s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:40 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Image conversion details: src /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab, size 1024.00 MB, duration 6.60 sec, destination /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d123f624-4e9d-48e0-a765-8064176e547b {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 05:52:40 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Converted 1024.00 MB image at 155.16 MB/s
Jun 26 05:52:40 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d123f624-4e9d-48e0-a765-8064176e547b is being set with open permissions: ugo+rw
Jun 26 05:52:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d123f624-4e9d-48e0-a765-8064176e547b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:40 devstack sudo[104792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d123f624-4e9d-48e0-a765-8064176e547b
Jun 26 05:52:40 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:41 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124" returned: 1 in 0.790s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Downloaded image dfc393ae-7412-4258-bda5-dc0a6732fb07 ((None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}])) to volume 5f17bb1f-3f3d-4c8c-8861-5e5d884cd124 successfully. {{(pid=93708) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Temporary image dfc393ae-7412-4258-bda5-dc0a6732fb07 for user 56679cdca79b41fe8059ff01e95b787b is deleted. {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Marking volume 5f17bb1f-3f3d-4c8c-8861-5e5d884cd124 as bootable. {{(pid=93708) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Copying metadata from image dfc393ae-7412-4258-bda5-dc0a6732fb07 to 5f17bb1f-3f3d-4c8c-8861-5e5d884cd124. {{(pid=93708) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Creating volume glance metadata for volume 5f17bb1f-3f3d-4c8c-8861-5e5d884cd124 backed by image dfc393ae-7412-4258-bda5-dc0a6732fb07 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93708) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b0b50b-2c91-4810-babe-1640975c1995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124', 'volume_size': 1, 'image_id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '672660d1b01a45828d72fce38b12f1f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'created_at': datetime.datetime(2026, 6, 26, 3, 35, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 3, 35, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfc393ae-7412-4258-bda5-dc0a6732fb07/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf43a5b710>}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9015908-9d49-4bd9-a9c9-9040e8ae52d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:41 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Volume volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124 (5f17bb1f-3f3d-4c8c-8861-5e5d884cd124): created successfully
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9015908-9d49-4bd9-a9c9-9040e8ae52d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Flow 'volume_create_manager' (f6120e12-36a8-43c4-9d15-a4afeeb3ec9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:52:41 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e51dad89-7a91-4f3f-a810-c5a39167af5e tempest-VolumesImageMetadata-2122852744 None] Created volume successfully.
Jun 26 05:52:41 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d123f624-4e9d-48e0-a765-8064176e547b" returned: 0 in 0.724s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-d123f624-4e9d-48e0-a765-8064176e547b" released by "_copy_volume_from_snapshot" :: held 10.179s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-76c22ef0-c99c-4115-972d-d703ae320ed1-d123f624-4e9d-48e0-a765-8064176e547b" released by "_create_volume_from_snapshot" :: held 10.219s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.242s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.504s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1346766625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de22793-7f50-4838-b4ef-eb44579f6810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84bed9b8b4ed475984b0aa2c9427d7ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:52:36Z,use_quota=True,user_id='e43a1f55a87541d885f132698206f785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Creating volume 1de22793-7f50-4838-b4ef-eb44579f6810 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:52:41 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1de22793-7f50-4838-b4ef-eb44579f6810 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:41 devstack sudo[104798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1de22793-7f50-4838-b4ef-eb44579f6810 1073741824
Jun 26 05:52:41 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199cb632-fd73-4940-a02e-ee9d654e24fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d123f624-4e9d-48e0-a765-8064176e547b', 'volume_size': 2, 'snapshot_id': '76c22ef0-c99c-4115-972d-d703ae320ed1'}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d4574a-50d5-4b20-ba1b-8bbcf025049e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:41 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Volume volume-d123f624-4e9d-48e0-a765-8064176e547b (d123f624-4e9d-48e0-a765-8064176e547b): created successfully
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d4574a-50d5-4b20-ba1b-8bbcf025049e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Flow 'volume_create_manager' (98f3e0cb-a1f0-4959-9022-9d6e3ee558fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:52:41 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-8ecc8ebf-457d-4ea2-b062-f177262d6d3e tempest-VolumesSnapshotTestJSON-899172881 None] Created volume successfully.
Jun 26 05:52:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1539b141-069c-44e0-a671-f54644a727be tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-d123f624-4e9d-48e0-a765-8064176e547b-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:52:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1539b141-069c-44e0-a671-f54644a727be tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-d123f624-4e9d-48e0-a765-8064176e547b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:52:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] Acquiring lock "cinder-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:52:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] Lock "cinder-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:52:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1539b141-069c-44e0-a671-f54644a727be tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-quobyte-d123f624-4e9d-48e0-a765-8064176e547b" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:52:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1539b141-069c-44e0-a671-f54644a727be tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-d123f624-4e9d-48e0-a765-8064176e547b" acquired by "delete_volume" :: waited 0.039s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:52:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] Acquiring lock "cinder-quobyte-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:52:42 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[2276f5f3-fc6a-4512-b4c0-350d5be6d757]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1539b141-069c-44e0-a671-f54644a727be tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d123f624-4e9d-48e0-a765-8064176e547b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] Lock "cinder-quobyte-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124" acquired by "delete_volume" :: waited 0.038s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:52:42 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[71296805-6eb5-4007-907d-a4572388b2b2]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:42 devstack sudo[104804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d123f624-4e9d-48e0-a765-8064176e547b
Jun 26 05:52:42 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:42 devstack sudo[104805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124
Jun 26 05:52:42 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:42 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1de22793-7f50-4838-b4ef-eb44579f6810 1073741824" returned: 0 in 1.187s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1de22793-7f50-4838-b4ef-eb44579f6810 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:42 devstack sudo[104808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1de22793-7f50-4838-b4ef-eb44579f6810
Jun 26 05:52:42 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:43 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1539b141-069c-44e0-a671-f54644a727be tempest-VolumesSnapshotTestJSON-899172881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d123f624-4e9d-48e0-a765-8064176e547b" returned: 0 in 1.148s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1539b141-069c-44e0-a671-f54644a727be tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d123f624-4e9d-48e0-a765-8064176e547b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:43 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124" returned: 0 in 1.077s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:43 devstack sudo[104816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d123f624-4e9d-48e0-a765-8064176e547b
Jun 26 05:52:43 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:43 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1de22793-7f50-4838-b4ef-eb44579f6810" returned: 0 in 0.859s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:43 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] <== create_volume: return (2104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:52:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.108s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:43 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37e7824-e3b6-463e-b1e8-df4b19b3eeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1de22793-7f50-4838-b4ef-eb44579f6810', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:43 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77368613-5768-48e2-85db-c5f2cf03db41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:43 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Volume volume-1de22793-7f50-4838-b4ef-eb44579f6810 (1de22793-7f50-4838-b4ef-eb44579f6810): created successfully
Jun 26 05:52:43 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77368613-5768-48e2-85db-c5f2cf03db41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:43 devstack sudo[104817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124
Jun 26 05:52:43 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:43 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Flow 'volume_create_manager' (2504c227-4ff1-4f50-be5e-2ec2b747fa1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:52:43 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-d2bf9235-8b44-4df8-829f-5e65cb5e1396 tempest-AttachVolumeNegativeTest-1214912838 None] Created volume successfully.
Jun 26 05:52:44 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1539b141-069c-44e0-a671-f54644a727be tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d123f624-4e9d-48e0-a765-8064176e547b" returned: 0 in 0.803s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1539b141-069c-44e0-a671-f54644a727be tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-d123f624-4e9d-48e0-a765-8064176e547b" released by "delete_volume" :: held 2.019s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:52:44 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124" returned: 1 in 0.906s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 05:52:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:44 devstack sudo[104824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124
Jun 26 05:52:44 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:44 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-1539b141-069c-44e0-a671-f54644a727be tempest-VolumesSnapshotTestJSON-899172881 None] Created reservations ['6697f7a6-1f98-40dd-95a1-3833f1279503', '3f416a3f-e97d-4ce7-9953-f4e92152bedb', '6a981c3e-0272-496a-9e32-8cbd589737ac', 'c31ee34e-507e-4b1e-8b97-9d82fa68ba06'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:52:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1539b141-069c-44e0-a671-f54644a727be tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1539b141-069c-44e0-a671-f54644a727be tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-1539b141-069c-44e0-a671-f54644a727be tempest-VolumesSnapshotTestJSON-899172881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:52:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-1539b141-069c-44e0-a671-f54644a727be tempest-VolumesSnapshotTestJSON-899172881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:52:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1539b141-069c-44e0-a671-f54644a727be tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1539b141-069c-44e0-a671-f54644a727be tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:44 devstack sudo[104829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:52:44 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:45 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124" returned: 0 in 0.890s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] Lock "cinder-quobyte-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124" released by "delete_volume" :: held 2.950s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] Created reservations ['ce1ddff1-6e16-4ceb-ae56-a18204e76b58', '84e95493-d5ff-4b59-b05b-54acc078dbe9', '75724d3d-1923-4f7f-86f2-6fd9b80d3473', '218002c5-0d3e-4204-a98d-10ae9f02fd37'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:52:45 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1539b141-069c-44e0-a671-f54644a727be tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.793s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-1539b141-069c-44e0-a671-f54644a727be tempest-VolumesSnapshotTestJSON-899172881 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:52:45 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-1539b141-069c-44e0-a671-f54644a727be tempest-VolumesSnapshotTestJSON-899172881 None] Deleted volume successfully.
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1539b141-069c-44e0-a671-f54644a727be tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-d123f624-4e9d-48e0-a765-8064176e547b-delete_volume" released by "delete_volume" :: held 3.233s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:45 devstack sudo[104833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:52:45 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-76c22ef0-c99c-4115-972d-d703ae320ed1-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-76c22ef0-c99c-4115-972d-d703ae320ed1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-quobyte-3d293eef-030f-4cc5-a3f9-b3d832182cab" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-3d293eef-030f-4cc5-a3f9-b3d832182cab" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-quobyte-76c22ef0-c99c-4115-972d-d703ae320ed1" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-76c22ef0-c99c-4115-972d-d703ae320ed1" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] Deleting offline snapshot 76c22ef0-c99c-4115-972d-d703ae320ed1 of volume 3d293eef-030f-4cc5-a3f9-b3d832182cab {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] snapshot_file for this snap is: volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb57d7b-3229-4d03-b717-0cba145f24bd]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:45 devstack sudo[104835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1
Jun 26 05:52:45 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:46 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.879s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:46 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:52:46 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] Deleted volume successfully.
Jun 26 05:52:46 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a4c3bdc8-396d-430d-a0d0-795f7b1052e2 tempest-VolumesImageMetadata-2122852744 None] Lock "cinder-5f17bb1f-3f3d-4c8c-8861-5e5d884cd124-delete_volume" released by "delete_volume" :: held 4.118s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:52:46 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1" returned: 0 in 0.938s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:46 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d293eef-030f-4cc5-a3f9-b3d832182cab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:52:46 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e83186-16aa-41b0-ab5b-8292867da43a]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:46 devstack sudo[104841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab
Jun 26 05:52:46 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-6b04b15b-009f-4e60-be80-5422c38683db req-6efec85d-2ecc-4c6d-845f-cbc1c473b32e tempest-AttachVolumeNegativeTest-1214912838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-6b04b15b-009f-4e60-be80-5422c38683db req-6efec85d-2ecc-4c6d-845f-cbc1c473b32e tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:47 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e39548-5512-43ad-bd67-8f676927005a]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-6b04b15b-009f-4e60-be80-5422c38683db req-6efec85d-2ecc-4c6d-845f-cbc1c473b32e tempest-AttachVolumeNegativeTest-1214912838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1de22793-7f50-4838-b4ef-eb44579f6810 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:47 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab" returned: 0 in 1.012s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:47 devstack sudo[104856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1
Jun 26 05:52:47 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:47 devstack sudo[104855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1de22793-7f50-4838-b4ef-eb44579f6810
Jun 26 05:52:47 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:48 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-6b04b15b-009f-4e60-be80-5422c38683db req-6efec85d-2ecc-4c6d-845f-cbc1c473b32e tempest-AttachVolumeNegativeTest-1214912838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1de22793-7f50-4838-b4ef-eb44579f6810" returned: 0 in 1.099s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-6b04b15b-009f-4e60-be80-5422c38683db req-6efec85d-2ecc-4c6d-845f-cbc1c473b32e tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.127s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-6b04b15b-009f-4e60-be80-5422c38683db req-6efec85d-2ecc-4c6d-845f-cbc1c473b32e tempest-AttachVolumeNegativeTest-1214912838 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85', 'name': 'volume-1de22793-7f50-4838-b4ef-eb44579f6810', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49fee238-b8bd-42ae-8afb-9bc1cc4c15f8', 'enforce_multipath': True} {{(pid=93708) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 05:52:48 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1" returned: 0 in 1.111s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:48 devstack sudo[104867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1
Jun 26 05:52:48 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:48 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-6b04b15b-009f-4e60-be80-5422c38683db req-6efec85d-2ecc-4c6d-845f-cbc1c473b32e tempest-AttachVolumeNegativeTest-1214912838 None] attachment_update completed successfully.
Jun 26 05:52:49 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab.76c22ef0-c99c-4115-972d-d703ae320ed1" returned: 0 in 0.887s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-76c22ef0-c99c-4115-972d-d703ae320ed1" released by "_delete_snapshot" :: held 4.128s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:52:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-3d293eef-030f-4cc5-a3f9-b3d832182cab" released by "delete_snapshot" :: held 4.186s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:52:49 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] Created reservations ['ce084e4d-8cac-4fd5-9142-0ce9b6a8cfc1', '9c86461b-4450-45aa-a08e-10c223ddc710', 'fe8173d7-4835-4dbb-ac6f-f03e8a6ce206', '4c7ea8b7-fb4a-4730-9fad-2e975182fae9'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:52:49 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] Delete snapshot completed successfully.
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5895e365-540d-4e31-81a1-10640dd7d426 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-76c22ef0-c99c-4115-972d-d703ae320ed1-delete_snapshot" released by "delete_snapshot" :: held 4.384s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Flow 'volume_create_manager' (3b3e0b3f-2321-4163-ae68-956be9dfb62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1286864-a086-4bde-b043-487e8c6b5eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1286864-a086-4bde-b043-487e8c6b5eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1488050547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf6d028-2465-402a-9bce-3d094a1592e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08504fd7144446cdb2a4843bdbf59963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:52:50Z,use_quota=True,user_id='c399953842dd49b6b031f50fdc20cf42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53bd10e-31ba-426b-b175-284a07904182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53bd10e-31ba-426b-b175-284a07904182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f919f321-f5ab-40de-9757-d37d2fb1119b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f919f321-f5ab-40de-9757-d37d2fb1119b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaf6d028-2465-402a-9bce-3d094a1592e5', 'volume_name': 'volume-eaf6d028-2465-402a-9bce-3d094a1592e5', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a648e57e-9014-4618-a5c4-cc57a21afb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a648e57e-9014-4618-a5c4-cc57a21afb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec5f63b-ec03-4e68-a37c-d708772156a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:50 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Volume eaf6d028-2465-402a-9bce-3d094a1592e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaf6d028-2465-402a-9bce-3d094a1592e5', 'volume_size': 1}
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1488050547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf6d028-2465-402a-9bce-3d094a1592e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08504fd7144446cdb2a4843bdbf59963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:52:50Z,use_quota=True,user_id='c399953842dd49b6b031f50fdc20cf42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Creating volume eaf6d028-2465-402a-9bce-3d094a1592e5 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:52:50 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:52:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:50 devstack sudo[105255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5 1073741824
Jun 26 05:52:50 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:51 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f11980be-245e-427f-bdf4-72240e4182ff tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-3d293eef-030f-4cc5-a3f9-b3d832182cab-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:52:51 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f11980be-245e-427f-bdf4-72240e4182ff tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-3d293eef-030f-4cc5-a3f9-b3d832182cab-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:52:51 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f11980be-245e-427f-bdf4-72240e4182ff tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-quobyte-3d293eef-030f-4cc5-a3f9-b3d832182cab" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:52:51 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f11980be-245e-427f-bdf4-72240e4182ff tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-3d293eef-030f-4cc5-a3f9-b3d832182cab" acquired by "delete_volume" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:52:51 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36b1216-43ce-4ea5-a708-b18b80d52acc]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f11980be-245e-427f-bdf4-72240e4182ff tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:51 devstack sudo[105257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab
Jun 26 05:52:51 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:51 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5 1073741824" returned: 0 in 0.967s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:51 devstack sudo[105263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5
Jun 26 05:52:51 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:52 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f11980be-245e-427f-bdf4-72240e4182ff tempest-VolumesSnapshotTestJSON-899172881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab" returned: 0 in 0.868s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f11980be-245e-427f-bdf4-72240e4182ff tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:52 devstack sudo[105270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab
Jun 26 05:52:52 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:52 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5" returned: 0 in 0.729s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:52 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:52:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec5f63b-ec03-4e68-a37c-d708772156a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaf6d028-2465-402a-9bce-3d094a1592e5', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e17bf72-2081-4108-9c04-44d3c81c5965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:52 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Volume volume-eaf6d028-2465-402a-9bce-3d094a1592e5 (eaf6d028-2465-402a-9bce-3d094a1592e5): created successfully
Jun 26 05:52:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e17bf72-2081-4108-9c04-44d3c81c5965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:52 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Flow 'volume_create_manager' (3b3e0b3f-2321-4163-ae68-956be9dfb62a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:52:52 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-5c2448bb-d487-44f8-b2a4-58450ec46206 tempest-VolumesDeleteCascade-1486156244 None] Created volume successfully.
Jun 26 05:52:52 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f11980be-245e-427f-bdf4-72240e4182ff tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-3d293eef-030f-4cc5-a3f9-b3d832182cab" returned: 0 in 0.736s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:52 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f11980be-245e-427f-bdf4-72240e4182ff tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-3d293eef-030f-4cc5-a3f9-b3d832182cab" released by "delete_volume" :: held 1.669s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:52:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7a4a1dfb-c34d-4d26-bd8d-af8577e76a6b tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7a4a1dfb-c34d-4d26-bd8d-af8577e76a6b tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:52 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-7a4a1dfb-c34d-4d26-bd8d-af8577e76a6b tempest-VolumesDeleteCascade-1486156244 None] Creating offline snapshot bd1ff041-9d56-40a6-9b81-f4e543e7d13f of volume eaf6d028-2465-402a-9bce-3d094a1592e5 {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:52:52 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cba368-2809-490c-a147-ad14628388b7]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:52:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7a4a1dfb-c34d-4d26-bd8d-af8577e76a6b tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:52 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-f11980be-245e-427f-bdf4-72240e4182ff tempest-VolumesSnapshotTestJSON-899172881 None] Created reservations ['ae19b57e-a8e1-46c6-bbb0-d89ba66b9a7a', '6e417fc0-16e1-4638-bd2b-0631d67bc51f', 'ecf795ea-9491-48e5-9ca8-162c79a34eb6', '3a770c22-dc75-4dfe-87ee-f921a5eaad9b'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:52:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f11980be-245e-427f-bdf4-72240e4182ff tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f11980be-245e-427f-bdf4-72240e4182ff tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:52 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f11980be-245e-427f-bdf4-72240e4182ff tempest-VolumesSnapshotTestJSON-899172881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:52:52 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f11980be-245e-427f-bdf4-72240e4182ff tempest-VolumesSnapshotTestJSON-899172881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:52:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f11980be-245e-427f-bdf4-72240e4182ff tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f11980be-245e-427f-bdf4-72240e4182ff tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:53 devstack sudo[105274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5
Jun 26 05:52:53 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:53 devstack sudo[105276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:52:53 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:54 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f11980be-245e-427f-bdf4-72240e4182ff tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.068s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:54 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-f11980be-245e-427f-bdf4-72240e4182ff tempest-VolumesSnapshotTestJSON-899172881 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:52:54 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-f11980be-245e-427f-bdf4-72240e4182ff tempest-VolumesSnapshotTestJSON-899172881 None] Deleted volume successfully.
Jun 26 05:52:54 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7a4a1dfb-c34d-4d26-bd8d-af8577e76a6b tempest-VolumesDeleteCascade-1486156244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5" returned: 0 in 1.243s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7a4a1dfb-c34d-4d26-bd8d-af8577e76a6b tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:54 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f11980be-245e-427f-bdf4-72240e4182ff tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-3d293eef-030f-4cc5-a3f9-b3d832182cab-delete_volume" released by "delete_volume" :: held 3.057s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:52:54 devstack sudo[105283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f 1G
Jun 26 05:52:54 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:54 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:52:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Flow 'volume_create_manager' (92049b9c-98d4-4ac9-b085-a068886e3c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:52:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1880415-c264-41f4-82e3-194f4f78c568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1880415-c264-41f4-82e3-194f4f78c568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-93726007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f6c445-ece2-4635-969a-9aa054198ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927dbdce0f354b5f9b88fa12fd57178f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:52:54Z,use_quota=True,user_id='060418eb63ba43eb8c4050c0f3bf3c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a848763-f368-4926-9a66-175d2e91c1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a848763-f368-4926-9a66-175d2e91c1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20fc1e2-34ca-46cd-910b-bbfb9d8ec6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20fc1e2-34ca-46cd-910b-bbfb9d8ec6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59f6c445-ece2-4635-969a-9aa054198ff4', 'volume_name': 'volume-59f6c445-ece2-4635-969a-9aa054198ff4', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727ca43b-bf88-4b91-ae0a-48cd77f50e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727ca43b-bf88-4b91-ae0a-48cd77f50e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:52:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06862cbf-0e5a-436f-a964-ec18dc5ff074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:52:54 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Volume 59f6c445-ece2-4635-969a-9aa054198ff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59f6c445-ece2-4635-969a-9aa054198ff4', 'volume_size': 1}
Jun 26 05:52:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:55 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7a4a1dfb-c34d-4d26-bd8d-af8577e76a6b tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f 1G" returned: 0 in 1.232s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7a4a1dfb-c34d-4d26-bd8d-af8577e76a6b tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaf6d028-2465-402a-9bce-3d094a1592e5 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:55 devstack sudo[105290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaf6d028-2465-402a-9bce-3d094a1592e5 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f
Jun 26 05:52:55 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:56 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7a4a1dfb-c34d-4d26-bd8d-af8577e76a6b tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaf6d028-2465-402a-9bce-3d094a1592e5 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f" returned: 0 in 0.789s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:56 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-7a4a1dfb-c34d-4d26-bd8d-af8577e76a6b tempest-VolumesDeleteCascade-1486156244 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f is being set with open permissions: ugo+rw
Jun 26 05:52:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7a4a1dfb-c34d-4d26-bd8d-af8577e76a6b tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:56 devstack sudo[105295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f
Jun 26 05:52:56 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:56 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7a4a1dfb-c34d-4d26-bd8d-af8577e76a6b tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f" returned: 0 in 0.770s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7a4a1dfb-c34d-4d26-bd8d-af8577e76a6b tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:56 devstack sudo[105298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.info
Jun 26 05:52:56 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:57 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7a4a1dfb-c34d-4d26-bd8d-af8577e76a6b tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.info" returned: 0 in 0.714s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:57 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-7a4a1dfb-c34d-4d26-bd8d-af8577e76a6b tempest-VolumesDeleteCascade-1486156244 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.info is being set with open permissions: ugo+rw
Jun 26 05:52:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7a4a1dfb-c34d-4d26-bd8d-af8577e76a6b tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:57 devstack sudo[105301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.info
Jun 26 05:52:57 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:58 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7a4a1dfb-c34d-4d26-bd8d-af8577e76a6b tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.info" returned: 0 in 0.727s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7a4a1dfb-c34d-4d26-bd8d-af8577e76a6b tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.602s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.945s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-93726007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f6c445-ece2-4635-969a-9aa054198ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927dbdce0f354b5f9b88fa12fd57178f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:52:54Z,use_quota=True,user_id='060418eb63ba43eb8c4050c0f3bf3c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:52:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Creating volume 59f6c445-ece2-4635-969a-9aa054198ff4 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:52:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:52:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:52:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:52:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:52:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:52:58 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:52:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:58 devstack sudo[105308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4 1073741824
Jun 26 05:52:58 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:52:58 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-7a4a1dfb-c34d-4d26-bd8d-af8577e76a6b tempest-VolumesDeleteCascade-1486156244 None] Create snapshot completed successfully
Jun 26 05:52:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ea3d895f-f050-4797-ba59-3cd9eefa9b33 tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:52:59 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root
Jun 26 05:52:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4 1073741824" returned: 0 in 1.142s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:52:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:52:59 devstack sudo[105319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4
Jun 26 05:52:59 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:00 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4" returned: 0 in 0.741s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:00 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:53:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ea3d895f-f050-4797-ba59-3cd9eefa9b33 tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.877s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06862cbf-0e5a-436f-a964-ec18dc5ff074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59f6c445-ece2-4635-969a-9aa054198ff4', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57eacd3b-848b-4f4f-8d78-05f54e774745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:00 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-ea3d895f-f050-4797-ba59-3cd9eefa9b33 tempest-VolumesDeleteCascade-1486156244 None] Creating offline snapshot 72c0a769-40d9-460d-b0d7-651cc36080fd of volume eaf6d028-2465-402a-9bce-3d094a1592e5 {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:53:00 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Volume volume-59f6c445-ece2-4635-969a-9aa054198ff4 (59f6c445-ece2-4635-969a-9aa054198ff4): created successfully
Jun 26 05:53:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57eacd3b-848b-4f4f-8d78-05f54e774745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Flow 'volume_create_manager' (92049b9c-98d4-4ac9-b085-a068886e3c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:53:00 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[28083028-b9fe-4f29-bdaa-00f59e3ea146]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ea3d895f-f050-4797-ba59-3cd9eefa9b33 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:00 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-50c55c0b-bc1d-4518-a2d7-19b590a8ca63 tempest-VolumesSnapshotTestJSON-899172881 None] Created volume successfully.
Jun 26 05:53:00 devstack sudo[105331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f
Jun 26 05:53:00 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7cf8acd0-cf3d-410d-91cb-3d1ce99ed443 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:01 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ea3d895f-f050-4797-ba59-3cd9eefa9b33 tempest-VolumesDeleteCascade-1486156244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f" returned: 0 in 0.952s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-ea3d895f-f050-4797-ba59-3cd9eefa9b33 tempest-VolumesDeleteCascade-1486156244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaf6d028-2465-402a-9bce-3d094a1592e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:53:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ea3d895f-f050-4797-ba59-3cd9eefa9b33 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.72c0a769-40d9-460d-b0d7-651cc36080fd 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:01 devstack sudo[105337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.72c0a769-40d9-460d-b0d7-651cc36080fd 1G
Jun 26 05:53:01 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Flow 'volume_create_manager' (e2c340be-4105-4ce8-81de-d4f555468723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e8b92d-dde3-445d-8b3d-00f4eea47f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e8b92d-dde3-445d-8b3d-00f4eea47f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1737481163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496d5827-ff8e-4c3b-aed6-214a659adc63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134c5bb3083e4178a5c730c540be2fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:53:02Z,use_quota=True,user_id='ecd9b3a0d6cf477bbcc0e3cdfd915967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b6976a-4d3a-41fe-be29-dd45362fee16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b6976a-4d3a-41fe-be29-dd45362fee16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4c3442-87bd-43a7-94f8-2bd3b0ad2d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4c3442-87bd-43a7-94f8-2bd3b0ad2d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '496d5827-ff8e-4c3b-aed6-214a659adc63', 'volume_name': 'volume-496d5827-ff8e-4c3b-aed6-214a659adc63', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27474bc1-f870-4b3e-ac7c-3ada59f8963e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27474bc1-f870-4b3e-ac7c-3ada59f8963e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b4fadf-6fb8-456f-ae91-d9c8c03263c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:02 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Volume 496d5827-ff8e-4c3b-aed6-214a659adc63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-496d5827-ff8e-4c3b-aed6-214a659adc63', 'volume_size': 1}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:02 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ea3d895f-f050-4797-ba59-3cd9eefa9b33 tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.72c0a769-40d9-460d-b0d7-651cc36080fd 1G" returned: 0 in 0.971s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ea3d895f-f050-4797-ba59-3cd9eefa9b33 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.72c0a769-40d9-460d-b0d7-651cc36080fd {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:02 devstack sudo[105343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.72c0a769-40d9-460d-b0d7-651cc36080fd
Jun 26 05:53:02 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Flow 'volume_create_manager' (8a5526f5-c77b-49c3-86a0-8b841769d7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b214c2-d767-4988-9ec9-3d58fccfc613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b214c2-d767-4988-9ec9-3d58fccfc613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1644152543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43e1ed8b-eb72-449e-91f4-430db293ea6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134c5bb3083e4178a5c730c540be2fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:53:02Z,use_quota=True,user_id='ecd9b3a0d6cf477bbcc0e3cdfd915967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5378c737-2df8-4fdc-8d48-29e0716d3783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5378c737-2df8-4fdc-8d48-29e0716d3783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562e184a-9224-4914-a835-2ec6a75a6f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562e184a-9224-4914-a835-2ec6a75a6f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43e1ed8b-eb72-449e-91f4-430db293ea6d', 'volume_name': 'volume-43e1ed8b-eb72-449e-91f4-430db293ea6d', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d60317-6fbd-4707-b3df-626159f216f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d60317-6fbd-4707-b3df-626159f216f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ee59e8-0eb7-4def-8643-6f60ced63c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:02 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Volume 43e1ed8b-eb72-449e-91f4-430db293ea6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43e1ed8b-eb72-449e-91f4-430db293ea6d', 'volume_size': 1}
Jun 26 05:53:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:03 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ea3d895f-f050-4797-ba59-3cd9eefa9b33 tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.72c0a769-40d9-460d-b0d7-651cc36080fd" returned: 0 in 0.835s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:03 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-ea3d895f-f050-4797-ba59-3cd9eefa9b33 tempest-VolumesDeleteCascade-1486156244 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.72c0a769-40d9-460d-b0d7-651cc36080fd is being set with open permissions: ugo+rw
Jun 26 05:53:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ea3d895f-f050-4797-ba59-3cd9eefa9b33 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.72c0a769-40d9-460d-b0d7-651cc36080fd {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:03 devstack sudo[105348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.72c0a769-40d9-460d-b0d7-651cc36080fd
Jun 26 05:53:03 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:03 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ea3d895f-f050-4797-ba59-3cd9eefa9b33 tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.72c0a769-40d9-460d-b0d7-651cc36080fd" returned: 0 in 0.709s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ea3d895f-f050-4797-ba59-3cd9eefa9b33 tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.639s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7cf8acd0-cf3d-410d-91cb-3d1ce99ed443 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.920s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:04 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-7cf8acd0-cf3d-410d-91cb-3d1ce99ed443 tempest-VolumesSnapshotTestJSON-899172881 None] Creating offline snapshot 415f7347-fac3-4522-80a0-d1d8ce2b01b3 of volume 59f6c445-ece2-4635-969a-9aa054198ff4 {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:53:04 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-ea3d895f-f050-4797-ba59-3cd9eefa9b33 tempest-VolumesDeleteCascade-1486156244 None] Create snapshot completed successfully
Jun 26 05:53:04 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[62400624-f252-4382-85cf-dfb40e963a28]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7cf8acd0-cf3d-410d-91cb-3d1ce99ed443 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:04 devstack sudo[105351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4
Jun 26 05:53:04 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:04 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "cinder-eaf6d028-2465-402a-9bce-3d094a1592e5-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:04 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-eaf6d028-2465-402a-9bce-3d094a1592e5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:04 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7cf8acd0-cf3d-410d-91cb-3d1ce99ed443 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4" returned: 0 in 0.831s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7cf8acd0-cf3d-410d-91cb-3d1ce99ed443 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:04 devstack sudo[105358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3 1G
Jun 26 05:53:04 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:04 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Performing cascade delete. {{(pid=93708) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jun 26 05:53:05 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "cinder-72c0a769-40d9-460d-b0d7-651cc36080fd-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:05 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-72c0a769-40d9-460d-b0d7-651cc36080fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:05 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "cinder-quobyte-eaf6d028-2465-402a-9bce-3d094a1592e5" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:05 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-eaf6d028-2465-402a-9bce-3d094a1592e5" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:05 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "cinder-quobyte-72c0a769-40d9-460d-b0d7-651cc36080fd" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:05 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-72c0a769-40d9-460d-b0d7-651cc36080fd" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:05 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Deleting offline snapshot 72c0a769-40d9-460d-b0d7-651cc36080fd of volume eaf6d028-2465-402a-9bce-3d094a1592e5 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:53:05 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] snapshot_file for this snap is: volume-eaf6d028-2465-402a-9bce-3d094a1592e5.72c0a769-40d9-460d-b0d7-651cc36080fd {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:53:05 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bd48ed-e415-4a88-bf52-f408a3de6f19]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.72c0a769-40d9-460d-b0d7-651cc36080fd {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:05 devstack sudo[105361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.72c0a769-40d9-460d-b0d7-651cc36080fd
Jun 26 05:53:05 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:06 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7cf8acd0-cf3d-410d-91cb-3d1ce99ed443 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3 1G" returned: 0 in 1.127s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7cf8acd0-cf3d-410d-91cb-3d1ce99ed443 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59f6c445-ece2-4635-969a-9aa054198ff4 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:06 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:06 devstack sudo[105372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59f6c445-ece2-4635-969a-9aa054198ff4 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3
Jun 26 05:53:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.72c0a769-40d9-460d-b0d7-651cc36080fd" returned: 0 in 0.952s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:06 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaf6d028-2465-402a-9bce-3d094a1592e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:53:06 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f8051d-f851-457a-936d-81c840b00c86]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:06 devstack sudo[105374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f
Jun 26 05:53:06 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:07 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7cf8acd0-cf3d-410d-91cb-3d1ce99ed443 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59f6c445-ece2-4635-969a-9aa054198ff4 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3" returned: 0 in 1.074s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:07 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-7cf8acd0-cf3d-410d-91cb-3d1ce99ed443 tempest-VolumesSnapshotTestJSON-899172881 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3 is being set with open permissions: ugo+rw
Jun 26 05:53:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7cf8acd0-cf3d-410d-91cb-3d1ce99ed443 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:07 devstack sudo[105382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3
Jun 26 05:53:07 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:07 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f" returned: 0 in 1.048s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaf6d028-2465-402a-9bce-3d094a1592e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:53:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.72c0a769-40d9-460d-b0d7-651cc36080fd {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:07 devstack sudo[105384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.72c0a769-40d9-460d-b0d7-651cc36080fd
Jun 26 05:53:07 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:07 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7cf8acd0-cf3d-410d-91cb-3d1ce99ed443 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3" returned: 0 in 0.787s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7cf8acd0-cf3d-410d-91cb-3d1ce99ed443 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:08 devstack sudo[105401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.info
Jun 26 05:53:08 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:08 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.72c0a769-40d9-460d-b0d7-651cc36080fd" returned: 0 in 1.113s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.72c0a769-40d9-460d-b0d7-651cc36080fd {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:08 devstack sudo[105410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.72c0a769-40d9-460d-b0d7-651cc36080fd
Jun 26 05:53:08 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:08 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7cf8acd0-cf3d-410d-91cb-3d1ce99ed443 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.info" returned: 0 in 0.791s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:08 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-7cf8acd0-cf3d-410d-91cb-3d1ce99ed443 tempest-VolumesSnapshotTestJSON-899172881 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.info is being set with open permissions: ugo+rw
Jun 26 05:53:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7cf8acd0-cf3d-410d-91cb-3d1ce99ed443 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:08 devstack sudo[105413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.info
Jun 26 05:53:08 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:09 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.72c0a769-40d9-460d-b0d7-651cc36080fd" returned: 0 in 0.699s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-72c0a769-40d9-460d-b0d7-651cc36080fd" released by "_delete_snapshot" :: held 3.934s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-eaf6d028-2465-402a-9bce-3d094a1592e5" released by "delete_snapshot" :: held 3.968s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Created reservations ['3ecae4d5-5096-4271-8682-52503d7c977e', '1e8824e8-8a58-4221-9d4a-a8b31748057a', '2a0440c9-d519-4fa6-8ebe-b6cbb811883f', 'f6b772e2-07b1-4ee1-9dac-471aefd17546'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:53:09 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Delete snapshot completed successfully.
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-72c0a769-40d9-460d-b0d7-651cc36080fd-delete_snapshot" released by "delete_snapshot" :: held 4.138s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "cinder-bd1ff041-9d56-40a6-9b81-f4e543e7d13f-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-bd1ff041-9d56-40a6-9b81-f4e543e7d13f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "cinder-quobyte-eaf6d028-2465-402a-9bce-3d094a1592e5" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-eaf6d028-2465-402a-9bce-3d094a1592e5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "cinder-quobyte-bd1ff041-9d56-40a6-9b81-f4e543e7d13f" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-bd1ff041-9d56-40a6-9b81-f4e543e7d13f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Deleting offline snapshot bd1ff041-9d56-40a6-9b81-f4e543e7d13f of volume eaf6d028-2465-402a-9bce-3d094a1592e5 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] snapshot_file for this snap is: volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8e5119-d07a-4c74-94da-85186ff86318]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:09 devstack sudo[105416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f
Jun 26 05:53:09 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:09 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7cf8acd0-cf3d-410d-91cb-3d1ce99ed443 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.info" returned: 0 in 0.716s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7cf8acd0-cf3d-410d-91cb-3d1ce99ed443 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.485s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.288s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1737481163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496d5827-ff8e-4c3b-aed6-214a659adc63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134c5bb3083e4178a5c730c540be2fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:53:02Z,use_quota=True,user_id='ecd9b3a0d6cf477bbcc0e3cdfd915967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Creating volume 496d5827-ff8e-4c3b-aed6-214a659adc63 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:53:09 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:53:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-496d5827-ff8e-4c3b-aed6-214a659adc63 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:09 devstack sudo[105443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-496d5827-ff8e-4c3b-aed6-214a659adc63 1073741824
Jun 26 05:53:09 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:09 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-7cf8acd0-cf3d-410d-91cb-3d1ce99ed443 tempest-VolumesSnapshotTestJSON-899172881 None] Create snapshot completed successfully
Jun 26 05:53:10 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f" returned: 0 in 0.905s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaf6d028-2465-402a-9bce-3d094a1592e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:53:10 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[95429e29-07be-404e-9b42-4d87ffac25b8]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:10 devstack sudo[105452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5
Jun 26 05:53:10 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:10 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-496d5827-ff8e-4c3b-aed6-214a659adc63 1073741824" returned: 0 in 1.028s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-496d5827-ff8e-4c3b-aed6-214a659adc63 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:10 devstack sudo[105454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-496d5827-ff8e-4c3b-aed6-214a659adc63
Jun 26 05:53:10 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:53:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:53:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:53:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:10 devstack sudo[105456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:53:10 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:11 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5" returned: 0 in 1.147s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:11 devstack sudo[105462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f
Jun 26 05:53:11 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:11 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:11 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:53:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-496d5827-ff8e-4c3b-aed6-214a659adc63" returned: 0 in 1.333s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] <== create_volume: return (2420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:53:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.423s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.339s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1644152543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43e1ed8b-eb72-449e-91f4-430db293ea6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134c5bb3083e4178a5c730c540be2fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:53:02Z,use_quota=True,user_id='ecd9b3a0d6cf477bbcc0e3cdfd915967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:53:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Creating volume 43e1ed8b-eb72-449e-91f4-430db293ea6d {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:53:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:53:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:53:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:53:11 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-43e1ed8b-eb72-449e-91f4-430db293ea6d 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:12 devstack sudo[105469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-43e1ed8b-eb72-449e-91f4-430db293ea6d 1073741824
Jun 26 05:53:12 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Flow 'volume_create_manager' (345f5f59-9e4e-40f1-98c5-27c3d38561ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e895f825-fee6-4d40-99cf-0a3b24a69d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b4fadf-6fb8-456f-ae91-d9c8c03263c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-496d5827-ff8e-4c3b-aed6-214a659adc63', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e24a98c9-898b-48fe-a7e9-db91fd20bee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e895f825-fee6-4d40-99cf-0a3b24a69d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2121944992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0155386-41a7-49c5-908a-5c2d3bfbe8c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927dbdce0f354b5f9b88fa12fd57178f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=415f7347-fac3-4522-80a0-d1d8ce2b01b3,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:53:12Z,use_quota=True,user_id='060418eb63ba43eb8c4050c0f3bf3c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554d74dd-4e77-4dd4-99d7-a76aa52845cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554d74dd-4e77-4dd4-99d7-a76aa52845cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60fe76a9-0fd0-42e7-afa8-657c9844a240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60fe76a9-0fd0-42e7-afa8-657c9844a240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f0155386-41a7-49c5-908a-5c2d3bfbe8c8', 'volume_name': 'volume-f0155386-41a7-49c5-908a-5c2d3bfbe8c8', 'volume_size': 1, 'snapshot_id': '415f7347-fac3-4522-80a0-d1d8ce2b01b3'}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46deff6-8f8c-4441-9b79-5689d97054f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46deff6-8f8c-4441-9b79-5689d97054f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7478c666-af64-494f-888c-eafb29cb94a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:12 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Volume f0155386-41a7-49c5-908a-5c2d3bfbe8c8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f0155386-41a7-49c5-908a-5c2d3bfbe8c8', 'volume_size': 1, 'snapshot_id': '415f7347-fac3-4522-80a0-d1d8ce2b01b3'}
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:12 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Volume volume-496d5827-ff8e-4c3b-aed6-214a659adc63 (496d5827-ff8e-4c3b-aed6-214a659adc63): created successfully
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e24a98c9-898b-48fe-a7e9-db91fd20bee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Flow 'volume_create_manager' (e2c340be-4105-4ce8-81de-d4f555468723) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:53:12 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e0bdf94f-4fe9-4962-bac0-fb188f1cb540 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Created volume successfully.
Jun 26 05:53:12 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.615s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 28 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>, <Thread(tpool_thread_0, started daemon 124035494721216)>, <Thread(tpool_thread_1, started daemon 124035486328512)>, <Thread(tpool_thread_2, started daemon 124035477919424)>, <Thread(tpool_thread_3, started daemon 124035469510336)>, <Thread(tpool_thread_4, started daemon 124035461101248)>, <Thread(tpool_thread_5, started daemon 124035452692160)>, <Thread(tpool_thread_6, started daemon 124035444283072)>, <Thread(tpool_thread_7, started daemon 124035435873984)>, <Thread(tpool_thread_8, started daemon 124035427464896)>, <Thread(tpool_thread_9, started daemon 124035419055808)>, <Thread(tpool_thread_10, started daemon 124035410646720)>, <Thread(tpool_thread_11, started daemon 124035402237632)>, <Thread(tpool_thread_12, started daemon 124035393828544)>, <Thread(tpool_thread_13, started daemon 124035385419456)>, <Thread(tpool_thread_14, started daemon 124035377010368)>, <Thread(tpool_thread_15, started daemon 124035368601280)>, <Thread(tpool_thread_16, started daemon 124035360192192)>, <Thread(tpool_thread_17, started daemon 124035351783104)>, <Thread(tpool_thread_18, started daemon 124035343374016)>, <Thread(tpool_thread_19, started daemon 124035334964928)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:53:12 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f" returned: 0 in 1.325s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:12 devstack sudo[105485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f
Jun 26 05:53:12 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:13 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-43e1ed8b-eb72-449e-91f4-430db293ea6d 1073741824" returned: 0 in 1.341s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-43e1ed8b-eb72-449e-91f4-430db293ea6d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:13 devstack sudo[105500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-43e1ed8b-eb72-449e-91f4-430db293ea6d
Jun 26 05:53:13 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:13 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5.bd1ff041-9d56-40a6-9b81-f4e543e7d13f" returned: 0 in 0.810s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:13 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-bd1ff041-9d56-40a6-9b81-f4e543e7d13f" released by "_delete_snapshot" :: held 4.295s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:13 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-eaf6d028-2465-402a-9bce-3d094a1592e5" released by "delete_snapshot" :: held 4.320s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:13 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Created reservations ['2dd77b00-2cca-4ab9-8582-040801831251', '2cad720b-594c-4c7b-a1a9-efd53aba5f11', 'dc7865c8-76b9-46b2-bfe7-9d1a4aa312b8', '30ffccb3-b3bc-4199-93a0-43c0b93b3fd9'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:53:13 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Delete snapshot completed successfully.
Jun 26 05:53:13 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-bd1ff041-9d56-40a6-9b81-f4e543e7d13f-delete_snapshot" released by "delete_snapshot" :: held 4.503s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:13 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Snapshots deleted, issuing volume delete {{(pid=93708) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jun 26 05:53:13 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "cinder-quobyte-eaf6d028-2465-402a-9bce-3d094a1592e5" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:13 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-eaf6d028-2465-402a-9bce-3d094a1592e5" acquired by "delete_volume" :: waited 0.028s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:13 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1fd693-8a71-424a-aaa0-00d03b7751e8]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:13 devstack sudo[105512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5
Jun 26 05:53:13 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:14 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-43e1ed8b-eb72-449e-91f4-430db293ea6d" returned: 0 in 0.829s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] <== create_volume: return (2225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.233s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.985s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-quobyte-415f7347-fac3-4522-80a0-d1d8ce2b01b3-f0155386-41a7-49c5-908a-5c2d3bfbe8c8" by "_create_volume_from_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ee59e8-0eb7-4def-8643-6f60ced63c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43e1ed8b-eb72-449e-91f4-430db293ea6d', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1cbdb33-2a53-44fb-a969-d2511cbd80a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-415f7347-fac3-4522-80a0-d1d8ce2b01b3-f0155386-41a7-49c5-908a-5c2d3bfbe8c8" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Creating volume f0155386-41a7-49c5-908a-5c2d3bfbe8c8 from snapshot 415f7347-fac3-4522-80a0-d1d8ce2b01b3 {{(pid=93708) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-quobyte-f0155386-41a7-49c5-908a-5c2d3bfbe8c8" by "_copy_volume_from_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-f0155386-41a7-49c5-908a-5c2d3bfbe8c8" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] snapshot: 415f7347-fac3-4522-80a0-d1d8ce2b01b3, volume: f0155386-41a7-49c5-908a-5c2d3bfbe8c8,  {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 05:53:14 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Volume volume-43e1ed8b-eb72-449e-91f4-430db293ea6d (43e1ed8b-eb72-449e-91f4-430db293ea6d): created successfully
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1cbdb33-2a53-44fb-a969-d2511cbd80a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Flow 'volume_create_manager' (8a5526f5-c77b-49c3-86a0-8b841769d7db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:53:14 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-f8e4251a-45be-4b5e-9eba-1bd844b02fe2 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Created volume successfully.
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c16c447-767d-462e-9659-e515ebe15d7e]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:14 devstack sudo[105546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3
Jun 26 05:53:14 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:15 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5" returned: 0 in 1.278s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:15 devstack sudo[105564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5
Jun 26 05:53:15 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:15 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3" returned: 0 in 1.073s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59f6c445-ece2-4635-969a-9aa054198ff4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:53:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4 {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 05:53:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Creating direct copy from snapshot {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 05:53:15 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[2471bfba-4a81-4133-86ae-0547a23615f0]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:15 devstack sudo[105571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4
Jun 26 05:53:15 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:16 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eaf6d028-2465-402a-9bce-3d094a1592e5" returned: 0 in 1.016s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-eaf6d028-2465-402a-9bce-3d094a1592e5" released by "delete_volume" :: held 2.410s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:16 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Created reservations ['65922da3-79b6-43ec-9797-b634facc13fe', '4d2fe8cc-90e6-4c0a-a77e-e581024b49e7', '8afc2a8d-97ed-4caf-8b02-2a7ee42347ef', 'adc55cae-6977-4627-a0d9-a38de0f9831a'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:53:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:53:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:53:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:16 devstack sudo[105576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:53:16 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:16 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4" returned: 0 in 1.126s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:16 devstack cinder-volume[93708]: DEBUG cinder.utils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Path /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f0155386-41a7-49c5-908a-5c2d3bfbe8c8 not found in is_blk_device check {{(pid=93708) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 05:53:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f0155386-41a7-49c5-908a-5c2d3bfbe8c8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:16 devstack sudo[105581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f0155386-41a7-49c5-908a-5c2d3bfbe8c8
Jun 26 05:53:16 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:17 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.772s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:17 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:53:17 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Deleted volume successfully.
Jun 26 05:53:17 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=92,cinder:INSERT=26,cinder:UPDATE=85,cinder:DELETE=10 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:53:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12d11b80-3a97-4ba1-a594-5c59626c7b3a tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-eaf6d028-2465-402a-9bce-3d094a1592e5-delete_volume" released by "delete_volume" :: held 12.267s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:18 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=90,cinder:INSERT=33,cinder:UPDATE=103,cinder:DELETE=7 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:53:19 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:53:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Flow 'volume_create_manager' (616a3d77-d80c-4f69-be05-baaf7bf5bbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:53:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99e53a5-e33c-4814-ab71-da58857b9ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99e53a5-e33c-4814-ab71-da58857b9ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1939390272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=063f145d-5e99-4d94-a59c-b3454c05eb4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08504fd7144446cdb2a4843bdbf59963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:53:19Z,use_quota=True,user_id='c399953842dd49b6b031f50fdc20cf42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52db084a-93f9-4afb-946b-dc98eb81cae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52db084a-93f9-4afb-946b-dc98eb81cae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a924e7-4037-4ca4-b9ea-65f127215ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a924e7-4037-4ca4-b9ea-65f127215ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '063f145d-5e99-4d94-a59c-b3454c05eb4b', 'volume_name': 'volume-063f145d-5e99-4d94-a59c-b3454c05eb4b', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e24a46-6197-4750-8f41-c44b8cf525d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e24a46-6197-4750-8f41-c44b8cf525d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c89449c-aba3-450f-b04d-9d1310660745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:19 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Volume 063f145d-5e99-4d94-a59c-b3454c05eb4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-063f145d-5e99-4d94-a59c-b3454c05eb4b', 'volume_size': 1}
Jun 26 05:53:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:26 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f0155386-41a7-49c5-908a-5c2d3bfbe8c8" returned: 0 in 10.255s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:26 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc301b8-fad3-472c-84c3-72c1e5a20527]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:27 devstack sudo[105720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4
Jun 26 05:53:27 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:28 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4" returned: 0 in 1.397s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:28 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Image conversion details: src /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4, size 1024.00 MB, duration 10.26 sec, destination /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f0155386-41a7-49c5-908a-5c2d3bfbe8c8 {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 05:53:28 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Converted 1024.00 MB image at 99.82 MB/s
Jun 26 05:53:28 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f0155386-41a7-49c5-908a-5c2d3bfbe8c8 is being set with open permissions: ugo+rw
Jun 26 05:53:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f0155386-41a7-49c5-908a-5c2d3bfbe8c8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:28 devstack sudo[105728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f0155386-41a7-49c5-908a-5c2d3bfbe8c8
Jun 26 05:53:28 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:28 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=1 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:53:29 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=1 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:53:29 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f0155386-41a7-49c5-908a-5c2d3bfbe8c8" returned: 0 in 1.027s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:29 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-f0155386-41a7-49c5-908a-5c2d3bfbe8c8" released by "_copy_volume_from_snapshot" :: held 15.107s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:29 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-415f7347-fac3-4522-80a0-d1d8ce2b01b3-f0155386-41a7-49c5-908a-5c2d3bfbe8c8" released by "_create_volume_from_snapshot" :: held 15.158s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.207s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.243s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1939390272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=063f145d-5e99-4d94-a59c-b3454c05eb4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08504fd7144446cdb2a4843bdbf59963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:53:19Z,use_quota=True,user_id='c399953842dd49b6b031f50fdc20cf42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:53:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Creating volume 063f145d-5e99-4d94-a59c-b3454c05eb4b {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:53:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:53:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:53:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:53:29 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:53:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:29 devstack sudo[105756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b 1073741824
Jun 26 05:53:29 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:29 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7478c666-af64-494f-888c-eafb29cb94a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0155386-41a7-49c5-908a-5c2d3bfbe8c8', 'volume_size': 1, 'snapshot_id': '415f7347-fac3-4522-80a0-d1d8ce2b01b3'}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:29 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5adf7f50-672c-49af-b40d-27b002eade42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:29 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Volume volume-f0155386-41a7-49c5-908a-5c2d3bfbe8c8 (f0155386-41a7-49c5-908a-5c2d3bfbe8c8): created successfully
Jun 26 05:53:29 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5adf7f50-672c-49af-b40d-27b002eade42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:29 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Flow 'volume_create_manager' (345f5f59-9e4e-40f1-98c5-27c3d38561ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:53:29 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-067a628f-65bb-4f6d-82cf-cfa36dd3e7e0 tempest-VolumesSnapshotTestJSON-899172881 None] Created volume successfully.
Jun 26 05:53:30 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b 1073741824" returned: 0 in 0.904s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-62340a33-99ab-4549-9dc8-a0847b68d0da tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-f0155386-41a7-49c5-908a-5c2d3bfbe8c8-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:30 devstack sudo[105761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b
Jun 26 05:53:30 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-62340a33-99ab-4549-9dc8-a0847b68d0da tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-f0155386-41a7-49c5-908a-5c2d3bfbe8c8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-62340a33-99ab-4549-9dc8-a0847b68d0da tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-quobyte-f0155386-41a7-49c5-908a-5c2d3bfbe8c8" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-62340a33-99ab-4549-9dc8-a0847b68d0da tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-f0155386-41a7-49c5-908a-5c2d3bfbe8c8" acquired by "delete_volume" :: waited 0.035s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:30 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cd0b70-2f23-4b8f-99b0-27b5034b4da6]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-62340a33-99ab-4549-9dc8-a0847b68d0da tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f0155386-41a7-49c5-908a-5c2d3bfbe8c8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:30 devstack sudo[105763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f0155386-41a7-49c5-908a-5c2d3bfbe8c8
Jun 26 05:53:30 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:31 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b" returned: 0 in 0.817s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:53:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:31 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c89449c-aba3-450f-b04d-9d1310660745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-063f145d-5e99-4d94-a59c-b3454c05eb4b', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:31 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d75d43e-89a3-48a2-8338-d973c61a05e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:31 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Volume volume-063f145d-5e99-4d94-a59c-b3454c05eb4b (063f145d-5e99-4d94-a59c-b3454c05eb4b): created successfully
Jun 26 05:53:31 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d75d43e-89a3-48a2-8338-d973c61a05e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:31 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Flow 'volume_create_manager' (616a3d77-d80c-4f69-be05-baaf7bf5bbfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:53:31 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-3e1a8e7f-6f88-421d-90d7-e811aa0f6801 tempest-VolumesDeleteCascade-1486156244 None] Created volume successfully.
Jun 26 05:53:31 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-62340a33-99ab-4549-9dc8-a0847b68d0da tempest-VolumesSnapshotTestJSON-899172881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f0155386-41a7-49c5-908a-5c2d3bfbe8c8" returned: 0 in 0.860s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-62340a33-99ab-4549-9dc8-a0847b68d0da tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f0155386-41a7-49c5-908a-5c2d3bfbe8c8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:31 devstack sudo[105769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f0155386-41a7-49c5-908a-5c2d3bfbe8c8
Jun 26 05:53:31 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e67799f4-d238-4838-87d1-fbc2536052d0 tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e67799f4-d238-4838-87d1-fbc2536052d0 tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-e67799f4-d238-4838-87d1-fbc2536052d0 tempest-VolumesDeleteCascade-1486156244 None] Creating offline snapshot 8df52ddb-93cf-4eb0-9dda-a901edc38b48 of volume 063f145d-5e99-4d94-a59c-b3454c05eb4b {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:53:31 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[928fcdea-567b-45ad-bc3b-5b7fa3aa69a7]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e67799f4-d238-4838-87d1-fbc2536052d0 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:32 devstack sudo[105772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b
Jun 26 05:53:32 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:32 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-62340a33-99ab-4549-9dc8-a0847b68d0da tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f0155386-41a7-49c5-908a-5c2d3bfbe8c8" returned: 0 in 0.746s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-62340a33-99ab-4549-9dc8-a0847b68d0da tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-f0155386-41a7-49c5-908a-5c2d3bfbe8c8" released by "delete_volume" :: held 1.674s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:32 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-62340a33-99ab-4549-9dc8-a0847b68d0da tempest-VolumesSnapshotTestJSON-899172881 None] Created reservations ['7e842aa4-64c5-45db-be7c-3e3045433863', '2dd8f2e4-5613-40df-b983-4d6d3fd705f6', '1784946c-d1fd-4361-b5ae-cb0b9527cdf0', '6b82de0c-8b37-449c-bb70-368eabe6d59c'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:53:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-62340a33-99ab-4549-9dc8-a0847b68d0da tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-62340a33-99ab-4549-9dc8-a0847b68d0da tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:32 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-62340a33-99ab-4549-9dc8-a0847b68d0da tempest-VolumesSnapshotTestJSON-899172881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:53:32 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-62340a33-99ab-4549-9dc8-a0847b68d0da tempest-VolumesSnapshotTestJSON-899172881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:53:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-62340a33-99ab-4549-9dc8-a0847b68d0da tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-62340a33-99ab-4549-9dc8-a0847b68d0da tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:32 devstack sudo[105789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:53:32 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-415f7347-fac3-4522-80a0-d1d8ce2b01b3-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:32 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e67799f4-d238-4838-87d1-fbc2536052d0 tempest-VolumesDeleteCascade-1486156244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b" returned: 0 in 0.889s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e67799f4-d238-4838-87d1-fbc2536052d0 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-415f7347-fac3-4522-80a0-d1d8ce2b01b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-quobyte-59f6c445-ece2-4635-969a-9aa054198ff4" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:32 devstack sudo[105794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48 1G
Jun 26 05:53:32 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-59f6c445-ece2-4635-969a-9aa054198ff4" acquired by "delete_snapshot" :: waited 0.049s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-quobyte-415f7347-fac3-4522-80a0-d1d8ce2b01b3" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-415f7347-fac3-4522-80a0-d1d8ce2b01b3" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:32 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] Deleting offline snapshot 415f7347-fac3-4522-80a0-d1d8ce2b01b3 of volume 59f6c445-ece2-4635-969a-9aa054198ff4 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:53:32 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] snapshot_file for this snap is: volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:53:33 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf35f48-0c6b-4951-849b-2167c1375953]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:33 devstack sudo[105796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3
Jun 26 05:53:33 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:33 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-62340a33-99ab-4549-9dc8-a0847b68d0da tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.805s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:33 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-62340a33-99ab-4549-9dc8-a0847b68d0da tempest-VolumesSnapshotTestJSON-899172881 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:53:33 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-62340a33-99ab-4549-9dc8-a0847b68d0da tempest-VolumesSnapshotTestJSON-899172881 None] Deleted volume successfully.
Jun 26 05:53:33 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-62340a33-99ab-4549-9dc8-a0847b68d0da tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-f0155386-41a7-49c5-908a-5c2d3bfbe8c8-delete_volume" released by "delete_volume" :: held 2.747s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:33 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e67799f4-d238-4838-87d1-fbc2536052d0 tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48 1G" returned: 0 in 0.945s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e67799f4-d238-4838-87d1-fbc2536052d0 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-063f145d-5e99-4d94-a59c-b3454c05eb4b -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:33 devstack sudo[105807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-063f145d-5e99-4d94-a59c-b3454c05eb4b -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48
Jun 26 05:53:33 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:33 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3" returned: 0 in 0.870s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59f6c445-ece2-4635-969a-9aa054198ff4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:53:33 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[c583a293-c054-42c2-93c7-232cd514125b]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:34 devstack sudo[105809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4
Jun 26 05:53:34 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:34 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e67799f4-d238-4838-87d1-fbc2536052d0 tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-063f145d-5e99-4d94-a59c-b3454c05eb4b -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48" returned: 0 in 0.769s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:34 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-e67799f4-d238-4838-87d1-fbc2536052d0 tempest-VolumesDeleteCascade-1486156244 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48 is being set with open permissions: ugo+rw
Jun 26 05:53:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e67799f4-d238-4838-87d1-fbc2536052d0 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:34 devstack sudo[105814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48
Jun 26 05:53:34 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:34 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4" returned: 0 in 0.865s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:34 devstack sudo[105819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3
Jun 26 05:53:34 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:35 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e67799f4-d238-4838-87d1-fbc2536052d0 tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48" returned: 0 in 0.743s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e67799f4-d238-4838-87d1-fbc2536052d0 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:35 devstack sudo[105822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.info
Jun 26 05:53:35 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:35 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3" returned: 0 in 1.010s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:35 devstack sudo[105828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3
Jun 26 05:53:35 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:36 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e67799f4-d238-4838-87d1-fbc2536052d0 tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.info" returned: 0 in 0.778s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:36 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-e67799f4-d238-4838-87d1-fbc2536052d0 tempest-VolumesDeleteCascade-1486156244 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.info is being set with open permissions: ugo+rw
Jun 26 05:53:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e67799f4-d238-4838-87d1-fbc2536052d0 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:36 devstack sudo[105831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.info
Jun 26 05:53:36 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:36 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4.415f7347-fac3-4522-80a0-d1d8ce2b01b3" returned: 0 in 0.811s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-415f7347-fac3-4522-80a0-d1d8ce2b01b3" released by "_delete_snapshot" :: held 3.696s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-59f6c445-ece2-4635-969a-9aa054198ff4" released by "delete_snapshot" :: held 3.735s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:36 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] Created reservations ['8502a300-286f-4daa-9caf-d51c42bd610d', 'c9ad88e6-4b9e-47d4-ae37-f4e3ac1dc9c7', 'b87a7338-d3cb-4ea6-8a8d-d858cd4a2531', '74f81e7a-d295-481c-99d2-55682376d6a1'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:53:36 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] Delete snapshot completed successfully.
Jun 26 05:53:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d262e29f-20e1-4bb6-997e-dc38064e6d91 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-415f7347-fac3-4522-80a0-d1d8ce2b01b3-delete_snapshot" released by "delete_snapshot" :: held 3.957s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:36 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e67799f4-d238-4838-87d1-fbc2536052d0 tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.info" returned: 0 in 0.787s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e67799f4-d238-4838-87d1-fbc2536052d0 tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.021s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:36 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e67799f4-d238-4838-87d1-fbc2536052d0 tempest-VolumesDeleteCascade-1486156244 None] Create snapshot completed successfully
Jun 26 05:53:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-29801349-19e0-41a2-86b2-785a06a052d4 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-59f6c445-ece2-4635-969a-9aa054198ff4-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-29801349-19e0-41a2-86b2-785a06a052d4 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-59f6c445-ece2-4635-969a-9aa054198ff4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-29801349-19e0-41a2-86b2-785a06a052d4 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-quobyte-59f6c445-ece2-4635-969a-9aa054198ff4" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-29801349-19e0-41a2-86b2-785a06a052d4 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-59f6c445-ece2-4635-969a-9aa054198ff4" acquired by "delete_volume" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:37 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b6f5d8-5915-4e7b-b82b-40bd7438daa4]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-29801349-19e0-41a2-86b2-785a06a052d4 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:37 devstack sudo[105857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4
Jun 26 05:53:37 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Flow 'volume_create_manager' (f219e93b-f909-4659-8b4b-7edc0d09e72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25fe1fa-a1f8-4d9f-8e8a-4f82dec53be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25fe1fa-a1f8-4d9f-8e8a-4f82dec53be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1119361197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b728ee9-924d-469b-b764-e0ab43ef92b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08504fd7144446cdb2a4843bdbf59963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8df52ddb-93cf-4eb0-9dda-a901edc38b48,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:53:38Z,use_quota=True,user_id='c399953842dd49b6b031f50fdc20cf42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (175ed971-8800-4e7e-ae16-5d8908548c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (175ed971-8800-4e7e-ae16-5d8908548c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037f94cc-292f-4024-ad08-c2025cdb8ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037f94cc-292f-4024-ad08-c2025cdb8ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0b728ee9-924d-469b-b764-e0ab43ef92b0', 'volume_name': 'volume-0b728ee9-924d-469b-b764-e0ab43ef92b0', 'volume_size': 1, 'snapshot_id': '8df52ddb-93cf-4eb0-9dda-a901edc38b48'}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bb5de7-bd1c-4ebc-bb26-33c664e23cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bb5de7-bd1c-4ebc-bb26-33c664e23cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2476cd3-d2ad-44d0-bb0a-13817bfff717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:38 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Volume 0b728ee9-924d-469b-b764-e0ab43ef92b0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0b728ee9-924d-469b-b764-e0ab43ef92b0', 'volume_size': 1, 'snapshot_id': '8df52ddb-93cf-4eb0-9dda-a901edc38b48'}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "cinder-quobyte-8df52ddb-93cf-4eb0-9dda-a901edc38b48-0b728ee9-924d-469b-b764-e0ab43ef92b0" by "_create_volume_from_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-8df52ddb-93cf-4eb0-9dda-a901edc38b48-0b728ee9-924d-469b-b764-e0ab43ef92b0" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Creating volume 0b728ee9-924d-469b-b764-e0ab43ef92b0 from snapshot 8df52ddb-93cf-4eb0-9dda-a901edc38b48 {{(pid=93708) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "cinder-quobyte-0b728ee9-924d-469b-b764-e0ab43ef92b0" by "_copy_volume_from_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-0b728ee9-924d-469b-b764-e0ab43ef92b0" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] snapshot: 8df52ddb-93cf-4eb0-9dda-a901edc38b48, volume: 0b728ee9-924d-469b-b764-e0ab43ef92b0,  {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[2beacc1e-b576-4257-8efc-d10e1738ecbd]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:38 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-29801349-19e0-41a2-86b2-785a06a052d4 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4" returned: 0 in 0.916s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-29801349-19e0-41a2-86b2-785a06a052d4 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:38 devstack sudo[105863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4
Jun 26 05:53:38 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:38 devstack sudo[105862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48
Jun 26 05:53:38 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:39 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-29801349-19e0-41a2-86b2-785a06a052d4 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-59f6c445-ece2-4635-969a-9aa054198ff4" returned: 0 in 0.985s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-29801349-19e0-41a2-86b2-785a06a052d4 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-59f6c445-ece2-4635-969a-9aa054198ff4" released by "delete_volume" :: held 2.024s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:39 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48" returned: 0 in 1.124s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-063f145d-5e99-4d94-a59c-b3454c05eb4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:53:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 05:53:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Creating direct copy from snapshot {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 05:53:39 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e97d64-d842-4004-ad68-a6e1174c3c5d]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:39 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-29801349-19e0-41a2-86b2-785a06a052d4 tempest-VolumesSnapshotTestJSON-899172881 None] Created reservations ['2ea25103-460c-4120-8a6e-c893270d6e48', 'd6af9488-c117-4f2f-a0d0-ea720822b0c7', 'a46b183b-4b8e-4fc3-9d67-01d0c9afbcb1', '48fb8bec-7966-4bb2-b632-4578061be12b'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:53:39 devstack sudo[105906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b
Jun 26 05:53:39 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-29801349-19e0-41a2-86b2-785a06a052d4 tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-29801349-19e0-41a2-86b2-785a06a052d4 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-29801349-19e0-41a2-86b2-785a06a052d4 tempest-VolumesSnapshotTestJSON-899172881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:53:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-29801349-19e0-41a2-86b2-785a06a052d4 tempest-VolumesSnapshotTestJSON-899172881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:53:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-29801349-19e0-41a2-86b2-785a06a052d4 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-29801349-19e0-41a2-86b2-785a06a052d4 tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:39 devstack sudo[105913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:53:39 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:40 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-29801349-19e0-41a2-86b2-785a06a052d4 tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.163s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:40 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-29801349-19e0-41a2-86b2-785a06a052d4 tempest-VolumesSnapshotTestJSON-899172881 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:53:40 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-29801349-19e0-41a2-86b2-785a06a052d4 tempest-VolumesSnapshotTestJSON-899172881 None] Deleted volume successfully.
Jun 26 05:53:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-71b8198d-6667-407c-b53b-c27e9ec8305f tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-1a3f10f9-4232-4222-8501-ff5bc07be04e-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-29801349-19e0-41a2-86b2-785a06a052d4 tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-59f6c445-ece2-4635-969a-9aa054198ff4-delete_volume" released by "delete_volume" :: held 3.712s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-71b8198d-6667-407c-b53b-c27e9ec8305f tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-1a3f10f9-4232-4222-8501-ff5bc07be04e-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:41 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b" returned: 0 in 1.604s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:41 devstack cinder-volume[93708]: DEBUG cinder.utils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Path /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b728ee9-924d-469b-b764-e0ab43ef92b0 not found in is_blk_device check {{(pid=93708) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 05:53:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b728ee9-924d-469b-b764-e0ab43ef92b0 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-71b8198d-6667-407c-b53b-c27e9ec8305f tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "cinder-quobyte-1a3f10f9-4232-4222-8501-ff5bc07be04e" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:41 devstack sudo[105935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b728ee9-924d-469b-b764-e0ab43ef92b0
Jun 26 05:53:41 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-71b8198d-6667-407c-b53b-c27e9ec8305f tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-1a3f10f9-4232-4222-8501-ff5bc07be04e" acquired by "delete_volume" :: waited 0.043s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:41 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5604818-aa27-494d-9fef-cb3c56294de6]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-71b8198d-6667-407c-b53b-c27e9ec8305f tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:41 devstack sudo[105937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e
Jun 26 05:53:41 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:42 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-71b8198d-6667-407c-b53b-c27e9ec8305f tempest-VolumesSnapshotTestJSON-899172881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e" returned: 0 in 1.551s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-71b8198d-6667-407c-b53b-c27e9ec8305f tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:42 devstack sudo[105959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e
Jun 26 05:53:42 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:44 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-71b8198d-6667-407c-b53b-c27e9ec8305f tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1a3f10f9-4232-4222-8501-ff5bc07be04e" returned: 0 in 1.466s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-71b8198d-6667-407c-b53b-c27e9ec8305f tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-quobyte-1a3f10f9-4232-4222-8501-ff5bc07be04e" released by "delete_volume" :: held 3.175s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:44 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-71b8198d-6667-407c-b53b-c27e9ec8305f tempest-VolumesSnapshotTestJSON-899172881 None] Created reservations ['3454af75-a525-4180-8c79-514dd6bc99f8', '24923b02-ade8-4d27-9c4b-1e284526019a', 'f4156943-5095-4faa-93d1-5d122fd576b1', 'e019fa38-8d3a-4bc7-b154-b6104d25076f'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:53:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-71b8198d-6667-407c-b53b-c27e9ec8305f tempest-VolumesSnapshotTestJSON-899172881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-71b8198d-6667-407c-b53b-c27e9ec8305f tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-71b8198d-6667-407c-b53b-c27e9ec8305f tempest-VolumesSnapshotTestJSON-899172881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:53:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-71b8198d-6667-407c-b53b-c27e9ec8305f tempest-VolumesSnapshotTestJSON-899172881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:53:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-71b8198d-6667-407c-b53b-c27e9ec8305f tempest-VolumesSnapshotTestJSON-899172881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-71b8198d-6667-407c-b53b-c27e9ec8305f tempest-VolumesSnapshotTestJSON-899172881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:44 devstack sudo[105962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:53:44 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:46 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-71b8198d-6667-407c-b53b-c27e9ec8305f tempest-VolumesSnapshotTestJSON-899172881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.626s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:46 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-71b8198d-6667-407c-b53b-c27e9ec8305f tempest-VolumesSnapshotTestJSON-899172881 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:53:46 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-71b8198d-6667-407c-b53b-c27e9ec8305f tempest-VolumesSnapshotTestJSON-899172881 None] Deleted volume successfully.
Jun 26 05:53:46 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-71b8198d-6667-407c-b53b-c27e9ec8305f tempest-VolumesSnapshotTestJSON-899172881 None] Lock "cinder-1a3f10f9-4232-4222-8501-ff5bc07be04e-delete_volume" released by "delete_volume" :: held 5.406s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:47 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b728ee9-924d-469b-b764-e0ab43ef92b0" returned: 0 in 6.659s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:47 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7df815-2586-4426-98cf-0ed3c9a85838]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:47 devstack sudo[105966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b
Jun 26 05:53:47 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:48 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b" returned: 0 in 1.026s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:48 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Image conversion details: src /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b728ee9-924d-469b-b764-e0ab43ef92b0 {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 05:53:48 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Converted 1024.00 MB image at 153.73 MB/s
Jun 26 05:53:48 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b728ee9-924d-469b-b764-e0ab43ef92b0 is being set with open permissions: ugo+rw
Jun 26 05:53:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b728ee9-924d-469b-b764-e0ab43ef92b0 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:48 devstack sudo[105974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b728ee9-924d-469b-b764-e0ab43ef92b0
Jun 26 05:53:48 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:49 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b728ee9-924d-469b-b764-e0ab43ef92b0" returned: 0 in 0.699s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-0b728ee9-924d-469b-b764-e0ab43ef92b0" released by "_copy_volume_from_snapshot" :: held 11.255s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-8df52ddb-93cf-4eb0-9dda-a901edc38b48-0b728ee9-924d-469b-b764-e0ab43ef92b0" released by "_create_volume_from_snapshot" :: held 11.290s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.307s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:49 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2476cd3-d2ad-44d0-bb0a-13817bfff717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b728ee9-924d-469b-b764-e0ab43ef92b0', 'volume_size': 1, 'snapshot_id': '8df52ddb-93cf-4eb0-9dda-a901edc38b48'}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:49 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5910c45d-7515-4216-bf73-58bb9d29bb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:49 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Volume volume-0b728ee9-924d-469b-b764-e0ab43ef92b0 (0b728ee9-924d-469b-b764-e0ab43ef92b0): created successfully
Jun 26 05:53:49 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5910c45d-7515-4216-bf73-58bb9d29bb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:49 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Flow 'volume_create_manager' (f219e93b-f909-4659-8b4b-7edc0d09e72a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:53:49 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-a76f5e21-7431-4dcf-a239-e436adb6ec3c tempest-VolumesDeleteCascade-1486156244 None] Created volume successfully.
Jun 26 05:53:50 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-0a8b3032-f6ff-4b0a-8b0c-7241a56567ea req-902bd7fd-bade-46eb-859f-5750c450b485 tempest-AttachVolumeNegativeTest-1214912838 None] Terminate volume connection completed successfully.
Jun 26 05:53:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-0a8b3032-f6ff-4b0a-8b0c-7241a56567ea req-902bd7fd-bade-46eb-859f-5750c450b485 tempest-AttachVolumeNegativeTest-1214912838 None] Deleting attachment 49fee238-b8bd-42ae-8afb-9bc1cc4c15f8. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 05:53:50 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "cinder-063f145d-5e99-4d94-a59c-b3454c05eb4b-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:50 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-063f145d-5e99-4d94-a59c-b3454c05eb4b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Performing cascade delete. {{(pid=93708) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jun 26 05:53:50 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "cinder-8df52ddb-93cf-4eb0-9dda-a901edc38b48-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:50 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-8df52ddb-93cf-4eb0-9dda-a901edc38b48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:50 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "cinder-quobyte-063f145d-5e99-4d94-a59c-b3454c05eb4b" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:50 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-063f145d-5e99-4d94-a59c-b3454c05eb4b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:50 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "cinder-quobyte-8df52ddb-93cf-4eb0-9dda-a901edc38b48" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:50 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-8df52ddb-93cf-4eb0-9dda-a901edc38b48" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:50 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Deleting offline snapshot 8df52ddb-93cf-4eb0-9dda-a901edc38b48 of volume 063f145d-5e99-4d94-a59c-b3454c05eb4b {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:53:50 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] snapshot_file for this snap is: volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:53:50 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[5867837b-811c-4fb5-82e9-19e4dbcff038]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:50 devstack sudo[105986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48
Jun 26 05:53:50 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:51 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48" returned: 0 in 0.911s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-063f145d-5e99-4d94-a59c-b3454c05eb4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:53:51 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[a671cbed-2040-4e54-b10e-18140ff4f4f7]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:51 devstack sudo[105992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b
Jun 26 05:53:51 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-9a15440a-17bc-4dde-809f-1d213fa0a0ea req-47692842-b516-4347-bd2a-2a10764209a7 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-9a15440a-17bc-4dde-809f-1d213fa0a0ea req-47692842-b516-4347-bd2a-2a10764209a7 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:52 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5e60b4-491f-4142-a6d1-1e29b7ebc37c]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-9a15440a-17bc-4dde-809f-1d213fa0a0ea req-47692842-b516-4347-bd2a-2a10764209a7 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-496d5827-ff8e-4c3b-aed6-214a659adc63 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:52 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b" returned: 0 in 0.867s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:52 devstack sudo[106007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48
Jun 26 05:53:52 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:52 devstack sudo[106006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-496d5827-ff8e-4c3b-aed6-214a659adc63
Jun 26 05:53:52 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:53 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48" returned: 0 in 0.847s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:53 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-9a15440a-17bc-4dde-809f-1d213fa0a0ea req-47692842-b516-4347-bd2a-2a10764209a7 tempest-TestServerVolumeAttachmentScenario-1039778867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-496d5827-ff8e-4c3b-aed6-214a659adc63" returned: 0 in 0.907s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-9a15440a-17bc-4dde-809f-1d213fa0a0ea req-47692842-b516-4347-bd2a-2a10764209a7 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.930s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:53 devstack sudo[106016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48
Jun 26 05:53:53 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-9a15440a-17bc-4dde-809f-1d213fa0a0ea req-47692842-b516-4347-bd2a-2a10764209a7 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85', 'name': 'volume-496d5827-ff8e-4c3b-aed6-214a659adc63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0829e777-0d29-49fc-9dc3-1046bdc24f06', 'enforce_multipath': True} {{(pid=93708) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 05:53:53 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-9a15440a-17bc-4dde-809f-1d213fa0a0ea req-47692842-b516-4347-bd2a-2a10764209a7 tempest-TestServerVolumeAttachmentScenario-1039778867 None] attachment_update completed successfully.
Jun 26 05:53:53 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Flow 'volume_create_manager' (4579cd7e-89a1-49c6-82dd-2613bb1ad87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90403a9a-9138-4cea-896a-f2b3c345c3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90403a9a-9138-4cea-896a-f2b3c345c3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f1497b-9dd1-414a-b04b-ce9fef8c5cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259b7fcaed47435ab27b7402fa2c90d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:53:54Z,use_quota=True,user_id='d6fa35f56a924f1c8727b4c23a76d3f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e91520-15c5-4c73-880c-48cf0a148f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e91520-15c5-4c73-880c-48cf0a148f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97c50a4-5f7b-4d90-8b20-48c5bc4e19e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97c50a4-5f7b-4d90-8b20-48c5bc4e19e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33f1497b-9dd1-414a-b04b-ce9fef8c5cfc', 'volume_name': 'volume-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef770397-10da-4437-a750-bdf54b48632d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef770397-10da-4437-a750-bdf54b48632d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85befc08-4cb5-4648-9a54-b5990ac215fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:54 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Volume 33f1497b-9dd1-414a-b04b-ce9fef8c5cfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc', 'volume_size': 1}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f1497b-9dd1-414a-b04b-ce9fef8c5cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259b7fcaed47435ab27b7402fa2c90d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:53:54Z,use_quota=True,user_id='d6fa35f56a924f1c8727b4c23a76d3f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Creating volume 33f1497b-9dd1-414a-b04b-ce9fef8c5cfc {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:53:54 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:54 devstack sudo[106103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc 1073741824
Jun 26 05:53:54 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:54 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b.8df52ddb-93cf-4eb0-9dda-a901edc38b48" returned: 0 in 1.420s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-8df52ddb-93cf-4eb0-9dda-a901edc38b48" released by "_delete_snapshot" :: held 4.162s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:54 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-063f145d-5e99-4d94-a59c-b3454c05eb4b" released by "delete_snapshot" :: held 4.184s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:55 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Created reservations ['7da4a2ba-de4a-4c3b-b6f4-0699ee03101f', '938c8285-cd52-4539-96b1-4e518866d1c1', 'd9e871bd-9e47-412b-8049-a426b26bf8d5', 'c6e0832b-c4a6-48c9-bc00-1364be5e06bc'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:53:55 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Delete snapshot completed successfully.
Jun 26 05:53:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-8df52ddb-93cf-4eb0-9dda-a901edc38b48-delete_snapshot" released by "delete_snapshot" :: held 4.410s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:55 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Snapshots deleted, issuing volume delete {{(pid=93708) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jun 26 05:53:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "cinder-quobyte-063f145d-5e99-4d94-a59c-b3454c05eb4b" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-063f145d-5e99-4d94-a59c-b3454c05eb4b" acquired by "delete_volume" :: waited 0.022s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:55 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e857fc8-eb56-46ca-9019-df96b61e33d9]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:55 devstack sudo[106488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b
Jun 26 05:53:55 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:55 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc 1073741824" returned: 0 in 1.362s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:55 devstack sudo[106508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc
Jun 26 05:53:55 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:56 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b" returned: 0 in 1.175s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:56 devstack sudo[106514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b
Jun 26 05:53:56 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:56 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc" returned: 0 in 0.811s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] <== create_volume: return (2277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:53:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.282s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85befc08-4cb5-4648-9a54-b5990ac215fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0504e1bd-3a67-4831-a8c8-e8e00c1c0da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:56 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Volume volume-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc (33f1497b-9dd1-414a-b04b-ce9fef8c5cfc): created successfully
Jun 26 05:53:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0504e1bd-3a67-4831-a8c8-e8e00c1c0da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Flow 'volume_create_manager' (4579cd7e-89a1-49c6-82dd-2613bb1ad87f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:53:56 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-d40b2a6a-8662-42cd-b3b4-cd4cd7678bfc tempest-CinderUnicodeTest-1102393691 None] Created volume successfully.
Jun 26 05:53:57 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-063f145d-5e99-4d94-a59c-b3454c05eb4b" returned: 0 in 0.739s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-063f145d-5e99-4d94-a59c-b3454c05eb4b" released by "delete_volume" :: held 2.021s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Created reservations ['ab25aa5c-de11-4791-a15d-8c20bb1940ca', '093ed109-f108-4532-bad9-5cfe0401470f', '5e0a71b7-28fc-44ca-96b6-d37286caf92f', '02484691-c287-4493-936d-ab77c0d04b56'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:57 devstack sudo[106521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:53:57 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dde66ecf-e7f1-4c38-95e0-1eed78e78b04 tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "cinder-0b728ee9-924d-469b-b764-e0ab43ef92b0-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dde66ecf-e7f1-4c38-95e0-1eed78e78b04 tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-0b728ee9-924d-469b-b764-e0ab43ef92b0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Flow 'volume_create_manager' (986826a1-35d3-4bdc-a5c3-9d97a2dff3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b1dc53-9006-479a-a896-06cfdeaf4b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b1dc53-9006-479a-a896-06cfdeaf4b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:53:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-347264780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06def28c-5ed3-453c-a387-df96375b5708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259b7fcaed47435ab27b7402fa2c90d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:53:58Z,use_quota=True,user_id='d6fa35f56a924f1c8727b4c23a76d3f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426376ac-1a5d-44e1-90a0-e4beaaab605b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426376ac-1a5d-44e1-90a0-e4beaaab605b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7821fb-b3e6-41f3-8c0b-c35011f9ccce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7821fb-b3e6-41f3-8c0b-c35011f9ccce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06def28c-5ed3-453c-a387-df96375b5708', 'volume_name': 'volume-06def28c-5ed3-453c-a387-df96375b5708', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2128264b-c114-42b1-b472-818214d56f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2128264b-c114-42b1-b472-818214d56f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e6bc9d-ecf1-4b3f-8cbf-543b20bbdc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:57 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Volume 06def28c-5ed3-453c-a387-df96375b5708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06def28c-5ed3-453c-a387-df96375b5708', 'volume_size': 1}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:53:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-347264780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06def28c-5ed3-453c-a387-df96375b5708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259b7fcaed47435ab27b7402fa2c90d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:53:58Z,use_quota=True,user_id='d6fa35f56a924f1c8727b4c23a76d3f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Creating volume 06def28c-5ed3-453c-a387-df96375b5708 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:53:57 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dde66ecf-e7f1-4c38-95e0-1eed78e78b04 tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "cinder-quobyte-0b728ee9-924d-469b-b764-e0ab43ef92b0" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:53:57 devstack sudo[106523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708 1073741824
Jun 26 05:53:57 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dde66ecf-e7f1-4c38-95e0-1eed78e78b04 tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-0b728ee9-924d-469b-b764-e0ab43ef92b0" acquired by "delete_volume" :: waited 0.017s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[f783ab22-1a9d-4516-b54d-27cb0daca3dc]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:53:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dde66ecf-e7f1-4c38-95e0-1eed78e78b04 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b728ee9-924d-469b-b764-e0ab43ef92b0 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:57 devstack sudo[106525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b728ee9-924d-469b-b764-e0ab43ef92b0
Jun 26 05:53:57 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:58 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.757s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:58 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:53:58 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Deleted volume successfully.
Jun 26 05:53:58 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fe0b59f1-8b1f-4dd6-a41d-cd2bf8302999 tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-063f145d-5e99-4d94-a59c-b3454c05eb4b-delete_volume" released by "delete_volume" :: held 7.512s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:58 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708 1073741824" returned: 0 in 0.927s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:58 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dde66ecf-e7f1-4c38-95e0-1eed78e78b04 tempest-VolumesDeleteCascade-1486156244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b728ee9-924d-469b-b764-e0ab43ef92b0" returned: 0 in 0.914s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dde66ecf-e7f1-4c38-95e0-1eed78e78b04 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b728ee9-924d-469b-b764-e0ab43ef92b0 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:58 devstack sudo[106535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708
Jun 26 05:53:58 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:58 devstack sudo[106536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b728ee9-924d-469b-b764-e0ab43ef92b0
Jun 26 05:53:58 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:53:59 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dde66ecf-e7f1-4c38-95e0-1eed78e78b04 tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b728ee9-924d-469b-b764-e0ab43ef92b0" returned: 0 in 0.696s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:59 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dde66ecf-e7f1-4c38-95e0-1eed78e78b04 tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-quobyte-0b728ee9-924d-469b-b764-e0ab43ef92b0" released by "delete_volume" :: held 1.670s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:53:59 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root
Jun 26 05:53:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708" returned: 0 in 0.754s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:53:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:53:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e6bc9d-ecf1-4b3f-8cbf-543b20bbdc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06def28c-5ed3-453c-a387-df96375b5708', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7abb3f-526c-4a80-95ab-126a25360e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:53:59 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Volume volume-06def28c-5ed3-453c-a387-df96375b5708 (06def28c-5ed3-453c-a387-df96375b5708): created successfully
Jun 26 05:53:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7abb3f-526c-4a80-95ab-126a25360e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:53:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Flow 'volume_create_manager' (986826a1-35d3-4bdc-a5c3-9d97a2dff3da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:53:59 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-d38db270-7379-4151-9852-9883c4ff6d5d tempest-CinderUnicodeTest-1102393691 None] Created volume successfully.
Jun 26 05:53:59 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-dde66ecf-e7f1-4c38-95e0-1eed78e78b04 tempest-VolumesDeleteCascade-1486156244 None] Created reservations ['0cf0872b-3bc2-494b-9a06-6b73083ba579', '00dbfffc-cd60-435f-84f1-c4f6e5f6f168', '83e85746-3d84-4d88-bec0-1c6ff22b6be6', 'a2b3fa18-fd61-4c68-a174-2ed1939696b6'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:53:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dde66ecf-e7f1-4c38-95e0-1eed78e78b04 tempest-VolumesDeleteCascade-1486156244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:53:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dde66ecf-e7f1-4c38-95e0-1eed78e78b04 tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:53:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dde66ecf-e7f1-4c38-95e0-1eed78e78b04 tempest-VolumesDeleteCascade-1486156244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:53:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dde66ecf-e7f1-4c38-95e0-1eed78e78b04 tempest-VolumesDeleteCascade-1486156244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:53:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dde66ecf-e7f1-4c38-95e0-1eed78e78b04 tempest-VolumesDeleteCascade-1486156244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:53:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dde66ecf-e7f1-4c38-95e0-1eed78e78b04 tempest-VolumesDeleteCascade-1486156244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:53:59 devstack sudo[106541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:53:59 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b37da404-9348-42f0-a67b-cdd22455059f tempest-CinderUnicodeTest-1102393691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:54:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b37da404-9348-42f0-a67b-cdd22455059f tempest-CinderUnicodeTest-1102393691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:54:00 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-b37da404-9348-42f0-a67b-cdd22455059f tempest-CinderUnicodeTest-1102393691 None] Creating offline snapshot 4a6ebed0-330a-4d95-8a72-7d8ded361926 of volume 06def28c-5ed3-453c-a387-df96375b5708 {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:54:00 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e44e00-b28f-4e3d-b9b8-f47df6e54b2e]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:54:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b37da404-9348-42f0-a67b-cdd22455059f tempest-CinderUnicodeTest-1102393691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:00 devstack sudo[106549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708
Jun 26 05:54:00 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:00 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dde66ecf-e7f1-4c38-95e0-1eed78e78b04 tempest-VolumesDeleteCascade-1486156244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.890s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:00 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-dde66ecf-e7f1-4c38-95e0-1eed78e78b04 tempest-VolumesDeleteCascade-1486156244 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:54:00 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-dde66ecf-e7f1-4c38-95e0-1eed78e78b04 tempest-VolumesDeleteCascade-1486156244 None] Deleted volume successfully.
Jun 26 05:54:00 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dde66ecf-e7f1-4c38-95e0-1eed78e78b04 tempest-VolumesDeleteCascade-1486156244 None] Lock "cinder-0b728ee9-924d-469b-b764-e0ab43ef92b0-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:54:01 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b37da404-9348-42f0-a67b-cdd22455059f tempest-CinderUnicodeTest-1102393691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708" returned: 0 in 1.111s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b37da404-9348-42f0-a67b-cdd22455059f tempest-CinderUnicodeTest-1102393691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.4a6ebed0-330a-4d95-8a72-7d8ded361926 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:01 devstack sudo[106556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.4a6ebed0-330a-4d95-8a72-7d8ded361926 1G
Jun 26 05:54:01 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:02 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b37da404-9348-42f0-a67b-cdd22455059f tempest-CinderUnicodeTest-1102393691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.4a6ebed0-330a-4d95-8a72-7d8ded361926 1G" returned: 0 in 1.324s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b37da404-9348-42f0-a67b-cdd22455059f tempest-CinderUnicodeTest-1102393691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06def28c-5ed3-453c-a387-df96375b5708 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.4a6ebed0-330a-4d95-8a72-7d8ded361926 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:02 devstack sudo[106572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06def28c-5ed3-453c-a387-df96375b5708 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.4a6ebed0-330a-4d95-8a72-7d8ded361926
Jun 26 05:54:02 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:03 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b37da404-9348-42f0-a67b-cdd22455059f tempest-CinderUnicodeTest-1102393691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06def28c-5ed3-453c-a387-df96375b5708 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.4a6ebed0-330a-4d95-8a72-7d8ded361926" returned: 0 in 1.030s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:03 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-b37da404-9348-42f0-a67b-cdd22455059f tempest-CinderUnicodeTest-1102393691 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.4a6ebed0-330a-4d95-8a72-7d8ded361926 is being set with open permissions: ugo+rw
Jun 26 05:54:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b37da404-9348-42f0-a67b-cdd22455059f tempest-CinderUnicodeTest-1102393691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.4a6ebed0-330a-4d95-8a72-7d8ded361926 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:03 devstack sudo[106579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.4a6ebed0-330a-4d95-8a72-7d8ded361926
Jun 26 05:54:03 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:04 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b37da404-9348-42f0-a67b-cdd22455059f tempest-CinderUnicodeTest-1102393691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.4a6ebed0-330a-4d95-8a72-7d8ded361926" returned: 0 in 0.735s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b37da404-9348-42f0-a67b-cdd22455059f tempest-CinderUnicodeTest-1102393691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:04 devstack sudo[106585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.info
Jun 26 05:54:04 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:05 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b37da404-9348-42f0-a67b-cdd22455059f tempest-CinderUnicodeTest-1102393691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.info" returned: 0 in 0.790s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:05 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-b37da404-9348-42f0-a67b-cdd22455059f tempest-CinderUnicodeTest-1102393691 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.info is being set with open permissions: ugo+rw
Jun 26 05:54:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b37da404-9348-42f0-a67b-cdd22455059f tempest-CinderUnicodeTest-1102393691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:05 devstack sudo[106588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.info
Jun 26 05:54:05 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:05 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b37da404-9348-42f0-a67b-cdd22455059f tempest-CinderUnicodeTest-1102393691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.info" returned: 0 in 0.701s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b37da404-9348-42f0-a67b-cdd22455059f tempest-CinderUnicodeTest-1102393691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.860s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:54:05 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-b37da404-9348-42f0-a67b-cdd22455059f tempest-CinderUnicodeTest-1102393691 None] Create snapshot completed successfully
Jun 26 05:54:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] Acquiring lock "cinder-4a6ebed0-330a-4d95-8a72-7d8ded361926-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:54:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] Lock "cinder-4a6ebed0-330a-4d95-8a72-7d8ded361926-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:54:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] Acquiring lock "cinder-quobyte-06def28c-5ed3-453c-a387-df96375b5708" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:54:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] Lock "cinder-quobyte-06def28c-5ed3-453c-a387-df96375b5708" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:54:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] Acquiring lock "cinder-quobyte-4a6ebed0-330a-4d95-8a72-7d8ded361926" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:54:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] Lock "cinder-quobyte-4a6ebed0-330a-4d95-8a72-7d8ded361926" acquired by "_delete_snapshot" :: waited 0.071s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:54:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] Deleting offline snapshot 4a6ebed0-330a-4d95-8a72-7d8ded361926 of volume 06def28c-5ed3-453c-a387-df96375b5708 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:54:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] snapshot_file for this snap is: volume-06def28c-5ed3-453c-a387-df96375b5708.4a6ebed0-330a-4d95-8a72-7d8ded361926 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:54:06 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[e813bc1d-3fa4-4576-97d7-e37c5a2c2fa2]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:54:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.4a6ebed0-330a-4d95-8a72-7d8ded361926 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-e2346070-63ed-4983-b140-d34c46d1bae7 req-c5a2ccf9-c77e-445b-bcc5-bc84b4bfd444 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:54:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-e2346070-63ed-4983-b140-d34c46d1bae7 req-c5a2ccf9-c77e-445b-bcc5-bc84b4bfd444 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:54:06 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faae86c-de20-4e8f-923b-3ebf54b4107b]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:54:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-e2346070-63ed-4983-b140-d34c46d1bae7 req-c5a2ccf9-c77e-445b-bcc5-bc84b4bfd444 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-43e1ed8b-eb72-449e-91f4-430db293ea6d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:06 devstack sudo[106602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.4a6ebed0-330a-4d95-8a72-7d8ded361926
Jun 26 05:54:06 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:06 devstack sudo[106603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-43e1ed8b-eb72-449e-91f4-430db293ea6d
Jun 26 05:54:06 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:07 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.4a6ebed0-330a-4d95-8a72-7d8ded361926" returned: 0 in 1.002s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06def28c-5ed3-453c-a387-df96375b5708(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:54:07 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-e2346070-63ed-4983-b140-d34c46d1bae7 req-c5a2ccf9-c77e-445b-bcc5-bc84b4bfd444 tempest-TestServerVolumeAttachmentScenario-1039778867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-43e1ed8b-eb72-449e-91f4-430db293ea6d" returned: 0 in 0.939s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-e2346070-63ed-4983-b140-d34c46d1bae7 req-c5a2ccf9-c77e-445b-bcc5-bc84b4bfd444 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.957s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:54:07 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[672ffd68-1468-4dcf-bc17-3d2db452e0d0]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:54:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:07 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-e2346070-63ed-4983-b140-d34c46d1bae7 req-c5a2ccf9-c77e-445b-bcc5-bc84b4bfd444 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85', 'name': 'volume-43e1ed8b-eb72-449e-91f4-430db293ea6d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'beb3288b-31c5-43a2-90f8-01b86543f849', 'enforce_multipath': True} {{(pid=93708) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 05:54:07 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-e2346070-63ed-4983-b140-d34c46d1bae7 req-c5a2ccf9-c77e-445b-bcc5-bc84b4bfd444 tempest-TestServerVolumeAttachmentScenario-1039778867 None] attachment_update completed successfully.
Jun 26 05:54:07 devstack sudo[106613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708
Jun 26 05:54:07 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:08 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708" returned: 0 in 0.826s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.4a6ebed0-330a-4d95-8a72-7d8ded361926 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:08 devstack sudo[106620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.4a6ebed0-330a-4d95-8a72-7d8ded361926
Jun 26 05:54:08 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:09 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.4a6ebed0-330a-4d95-8a72-7d8ded361926" returned: 0 in 1.038s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.4a6ebed0-330a-4d95-8a72-7d8ded361926 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:09 devstack sudo[106630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.4a6ebed0-330a-4d95-8a72-7d8ded361926
Jun 26 05:54:09 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:10 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708.4a6ebed0-330a-4d95-8a72-7d8ded361926" returned: 0 in 0.661s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:10 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] Lock "cinder-quobyte-4a6ebed0-330a-4d95-8a72-7d8ded361926" released by "_delete_snapshot" :: held 3.663s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:54:10 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] Lock "cinder-quobyte-06def28c-5ed3-453c-a387-df96375b5708" released by "delete_snapshot" :: held 3.746s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:54:10 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] Created reservations ['9bc92522-26b0-43d3-bf80-941799605c2c', '4f0755b7-fab6-4af8-a95d-39aa2f90beb4', '364bc175-0514-4fae-b484-c98bff425b1b', '63fc8553-3d0d-46e2-b7f5-d9da1d0f8878'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:54:10 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] Delete snapshot completed successfully.
Jun 26 05:54:10 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-51cf2a21-825f-4bb3-bad1-0b6ae6078c38 tempest-CinderUnicodeTest-1102393691 None] Lock "cinder-4a6ebed0-330a-4d95-8a72-7d8ded361926-delete_snapshot" released by "delete_snapshot" :: held 3.936s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:54:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:54:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:54:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:54:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:54:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:54:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:54:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:10 devstack sudo[106633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:54:10 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:10 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2cc0ba9d-631a-4447-acd2-27eb5b0eed2f tempest-CinderUnicodeTest-1102393691 None] Acquiring lock "cinder-06def28c-5ed3-453c-a387-df96375b5708-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:54:10 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2cc0ba9d-631a-4447-acd2-27eb5b0eed2f tempest-CinderUnicodeTest-1102393691 None] Lock "cinder-06def28c-5ed3-453c-a387-df96375b5708-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:54:10 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2cc0ba9d-631a-4447-acd2-27eb5b0eed2f tempest-CinderUnicodeTest-1102393691 None] Acquiring lock "cinder-quobyte-06def28c-5ed3-453c-a387-df96375b5708" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:54:10 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2cc0ba9d-631a-4447-acd2-27eb5b0eed2f tempest-CinderUnicodeTest-1102393691 None] Lock "cinder-quobyte-06def28c-5ed3-453c-a387-df96375b5708" acquired by "delete_volume" :: waited 0.028s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:54:10 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21e577e-1d89-47da-a95d-c485086bd15d]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:54:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2cc0ba9d-631a-4447-acd2-27eb5b0eed2f tempest-CinderUnicodeTest-1102393691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:11 devstack sudo[106635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708
Jun 26 05:54:11 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:11 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.946s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:11 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:54:11 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:54:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 28 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:54:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>, <Thread(tpool_thread_0, started daemon 124035494721216)>, <Thread(tpool_thread_1, started daemon 124035486328512)>, <Thread(tpool_thread_2, started daemon 124035477919424)>, <Thread(tpool_thread_3, started daemon 124035469510336)>, <Thread(tpool_thread_4, started daemon 124035461101248)>, <Thread(tpool_thread_5, started daemon 124035452692160)>, <Thread(tpool_thread_6, started daemon 124035444283072)>, <Thread(tpool_thread_7, started daemon 124035435873984)>, <Thread(tpool_thread_8, started daemon 124035427464896)>, <Thread(tpool_thread_9, started daemon 124035419055808)>, <Thread(tpool_thread_10, started daemon 124035410646720)>, <Thread(tpool_thread_11, started daemon 124035402237632)>, <Thread(tpool_thread_12, started daemon 124035393828544)>, <Thread(tpool_thread_13, started daemon 124035385419456)>, <Thread(tpool_thread_14, started daemon 124035377010368)>, <Thread(tpool_thread_15, started daemon 124035368601280)>, <Thread(tpool_thread_16, started daemon 124035360192192)>, <Thread(tpool_thread_17, started daemon 124035351783104)>, <Thread(tpool_thread_18, started daemon 124035343374016)>, <Thread(tpool_thread_19, started daemon 124035334964928)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:54:12 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2cc0ba9d-631a-4447-acd2-27eb5b0eed2f tempest-CinderUnicodeTest-1102393691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708" returned: 0 in 1.309s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2cc0ba9d-631a-4447-acd2-27eb5b0eed2f tempest-CinderUnicodeTest-1102393691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:12 devstack sudo[106643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708
Jun 26 05:54:12 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:13 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2cc0ba9d-631a-4447-acd2-27eb5b0eed2f tempest-CinderUnicodeTest-1102393691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-06def28c-5ed3-453c-a387-df96375b5708" returned: 0 in 0.812s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:13 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2cc0ba9d-631a-4447-acd2-27eb5b0eed2f tempest-CinderUnicodeTest-1102393691 None] Lock "cinder-quobyte-06def28c-5ed3-453c-a387-df96375b5708" released by "delete_volume" :: held 2.226s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:54:13 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-2cc0ba9d-631a-4447-acd2-27eb5b0eed2f tempest-CinderUnicodeTest-1102393691 None] Created reservations ['80d75c34-aacc-410e-ac94-232fb0bc4f65', '2e9952e2-824f-43da-b6ad-765fdb87739f', 'd39bdbd8-9617-4658-aad1-0d2ec7f0f1d3', '5acb8d3b-a95d-4af9-b5c0-ef0e651745d7'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:54:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2cc0ba9d-631a-4447-acd2-27eb5b0eed2f tempest-CinderUnicodeTest-1102393691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:54:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2cc0ba9d-631a-4447-acd2-27eb5b0eed2f tempest-CinderUnicodeTest-1102393691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:54:13 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2cc0ba9d-631a-4447-acd2-27eb5b0eed2f tempest-CinderUnicodeTest-1102393691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:54:13 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2cc0ba9d-631a-4447-acd2-27eb5b0eed2f tempest-CinderUnicodeTest-1102393691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:54:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2cc0ba9d-631a-4447-acd2-27eb5b0eed2f tempest-CinderUnicodeTest-1102393691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:54:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2cc0ba9d-631a-4447-acd2-27eb5b0eed2f tempest-CinderUnicodeTest-1102393691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:13 devstack sudo[106667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:54:13 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:14 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2cc0ba9d-631a-4447-acd2-27eb5b0eed2f tempest-CinderUnicodeTest-1102393691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.792s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:14 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-2cc0ba9d-631a-4447-acd2-27eb5b0eed2f tempest-CinderUnicodeTest-1102393691 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:54:14 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-2cc0ba9d-631a-4447-acd2-27eb5b0eed2f tempest-CinderUnicodeTest-1102393691 None] Deleted volume successfully.
Jun 26 05:54:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2cc0ba9d-631a-4447-acd2-27eb5b0eed2f tempest-CinderUnicodeTest-1102393691 None] Lock "cinder-06def28c-5ed3-453c-a387-df96375b5708-delete_volume" released by "delete_volume" :: held 3.380s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:54:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-35d57d7c-ec28-43ac-8711-09edc2bb3e48 tempest-CinderUnicodeTest-1102393691 None] Acquiring lock "cinder-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:54:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-35d57d7c-ec28-43ac-8711-09edc2bb3e48 tempest-CinderUnicodeTest-1102393691 None] Lock "cinder-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:54:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-35d57d7c-ec28-43ac-8711-09edc2bb3e48 tempest-CinderUnicodeTest-1102393691 None] Acquiring lock "cinder-quobyte-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:54:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-35d57d7c-ec28-43ac-8711-09edc2bb3e48 tempest-CinderUnicodeTest-1102393691 None] Lock "cinder-quobyte-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc" acquired by "delete_volume" :: waited 0.015s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:54:14 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[7710d5c7-3dc5-4ec1-8ca3-b3500ef3ebd1]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:54:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-35d57d7c-ec28-43ac-8711-09edc2bb3e48 tempest-CinderUnicodeTest-1102393691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:14 devstack sudo[106671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc
Jun 26 05:54:14 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:14 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-1ef326d4-cb50-43ed-9445-0e45e05553ef req-cdf270da-397a-4b33-af38-57dc372e9366 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Terminate volume connection completed successfully.
Jun 26 05:54:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-1ef326d4-cb50-43ed-9445-0e45e05553ef req-cdf270da-397a-4b33-af38-57dc372e9366 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Deleting attachment beb3288b-31c5-43a2-90f8-01b86543f849. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 05:54:15 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-35d57d7c-ec28-43ac-8711-09edc2bb3e48 tempest-CinderUnicodeTest-1102393691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc" returned: 0 in 0.859s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-35d57d7c-ec28-43ac-8711-09edc2bb3e48 tempest-CinderUnicodeTest-1102393691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:15 devstack sudo[106708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc
Jun 26 05:54:15 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:16 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-35d57d7c-ec28-43ac-8711-09edc2bb3e48 tempest-CinderUnicodeTest-1102393691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc" returned: 0 in 0.825s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-35d57d7c-ec28-43ac-8711-09edc2bb3e48 tempest-CinderUnicodeTest-1102393691 None] Lock "cinder-quobyte-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc" released by "delete_volume" :: held 1.729s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:54:16 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-35d57d7c-ec28-43ac-8711-09edc2bb3e48 tempest-CinderUnicodeTest-1102393691 None] Created reservations ['4f213207-855d-4e39-be94-eeabc3c69dd2', '3e2a2d0b-3176-4ae4-aa86-21b686251a28', '74b8afb4-1313-4a52-853b-2e734eb77c2b', '53f365d6-b151-472c-b8ea-2adac5bfe494'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:54:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-35d57d7c-ec28-43ac-8711-09edc2bb3e48 tempest-CinderUnicodeTest-1102393691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:54:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-35d57d7c-ec28-43ac-8711-09edc2bb3e48 tempest-CinderUnicodeTest-1102393691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:54:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-35d57d7c-ec28-43ac-8711-09edc2bb3e48 tempest-CinderUnicodeTest-1102393691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:54:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-35d57d7c-ec28-43ac-8711-09edc2bb3e48 tempest-CinderUnicodeTest-1102393691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:54:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-35d57d7c-ec28-43ac-8711-09edc2bb3e48 tempest-CinderUnicodeTest-1102393691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:54:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-35d57d7c-ec28-43ac-8711-09edc2bb3e48 tempest-CinderUnicodeTest-1102393691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:16 devstack sudo[106711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:54:16 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:17 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-35d57d7c-ec28-43ac-8711-09edc2bb3e48 tempest-CinderUnicodeTest-1102393691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.914s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-35d57d7c-ec28-43ac-8711-09edc2bb3e48 tempest-CinderUnicodeTest-1102393691 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:54:17 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-35d57d7c-ec28-43ac-8711-09edc2bb3e48 tempest-CinderUnicodeTest-1102393691 None] Deleted volume successfully.
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-35d57d7c-ec28-43ac-8711-09edc2bb3e48 tempest-CinderUnicodeTest-1102393691 None] Lock "cinder-33f1497b-9dd1-414a-b04b-ce9fef8c5cfc-delete_volume" released by "delete_volume" :: held 2.920s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Flow 'volume_create_manager' (2ff42cd8-716e-4066-a104-ca556f031302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717e53f1-b60a-4233-91b3-5bdc12554ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717e53f1-b60a-4233-91b3-5bdc12554ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1237120170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ff5b3a-b2c3-4923-9c21-cea47ee5f17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0287acec06c24f4193bbe81cc4ad1796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:54:17Z,use_quota=True,user_id='728252f5bcd24f7994050db9df992e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35960f8e-e22b-4ab1-b022-ba0c935aaf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35960f8e-e22b-4ab1-b022-ba0c935aaf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e11054e-ede7-4f9b-b9a9-53a7836d6bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e11054e-ede7-4f9b-b9a9-53a7836d6bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16ff5b3a-b2c3-4923-9c21-cea47ee5f17a', 'volume_name': 'volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef898a17-be33-469e-b624-3e6ce504e27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef898a17-be33-469e-b624-3e6ce504e27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88134f7-9544-4e4a-9622-a58449cd4a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:17 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Volume 16ff5b3a-b2c3-4923-9c21-cea47ee5f17a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a', 'volume_size': 1}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1237120170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ff5b3a-b2c3-4923-9c21-cea47ee5f17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0287acec06c24f4193bbe81cc4ad1796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:54:17Z,use_quota=True,user_id='728252f5bcd24f7994050db9df992e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Creating volume 16ff5b3a-b2c3-4923-9c21-cea47ee5f17a {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:54:17 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:54:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:17 devstack sudo[106714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a 1073741824
Jun 26 05:54:17 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:18 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a 1073741824" returned: 0 in 0.974s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:18 devstack sudo[106723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a
Jun 26 05:54:18 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:19 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-394961c8-cd7e-48d9-a607-d3f82d5c0eac req-e9292825-070f-4966-bcd1-29103a622108 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Terminate volume connection completed successfully.
Jun 26 05:54:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-394961c8-cd7e-48d9-a607-d3f82d5c0eac req-e9292825-070f-4966-bcd1-29103a622108 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Deleting attachment 0829e777-0d29-49fc-9dc3-1046bdc24f06. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 05:54:19 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a" returned: 0 in 0.730s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:19 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:54:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:54:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88134f7-9544-4e4a-9622-a58449cd4a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa6d142-4209-4308-a367-bd43b8b2663a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:19 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Volume volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a (16ff5b3a-b2c3-4923-9c21-cea47ee5f17a): created successfully
Jun 26 05:54:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa6d142-4209-4308-a367-bd43b8b2663a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Flow 'volume_create_manager' (2ff42cd8-716e-4066-a104-ca556f031302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:54:19 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-8dc8ee52-c880-4308-82a5-51e706d2a822 tempest-VolumesActionsTest-1819492261 None] Created volume successfully.
Jun 26 05:54:29 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=84,cinder:UPDATE=94,cinder:INSERT=21,cinder:DELETE=7 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:54:29 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=93,cinder:DELETE=8,cinder:INSERT=25,cinder:SELECT=81 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:54:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c07deeba-c467-4fd1-a4b3-00728bff5895 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Acquiring lock "cinder-43e1ed8b-eb72-449e-91f4-430db293ea6d-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:54:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c07deeba-c467-4fd1-a4b3-00728bff5895 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "cinder-43e1ed8b-eb72-449e-91f4-430db293ea6d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:54:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c07deeba-c467-4fd1-a4b3-00728bff5895 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Acquiring lock "cinder-quobyte-43e1ed8b-eb72-449e-91f4-430db293ea6d" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:54:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c07deeba-c467-4fd1-a4b3-00728bff5895 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "cinder-quobyte-43e1ed8b-eb72-449e-91f4-430db293ea6d" acquired by "delete_volume" :: waited 0.024s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:54:32 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1275bf-8d35-44b5-b466-5a6037faec9f]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:54:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c07deeba-c467-4fd1-a4b3-00728bff5895 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-43e1ed8b-eb72-449e-91f4-430db293ea6d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:33 devstack sudo[106918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-43e1ed8b-eb72-449e-91f4-430db293ea6d
Jun 26 05:54:33 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:33 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c07deeba-c467-4fd1-a4b3-00728bff5895 tempest-TestServerVolumeAttachmentScenario-1039778867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-43e1ed8b-eb72-449e-91f4-430db293ea6d" returned: 0 in 0.985s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c07deeba-c467-4fd1-a4b3-00728bff5895 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-43e1ed8b-eb72-449e-91f4-430db293ea6d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:33 devstack sudo[106924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-43e1ed8b-eb72-449e-91f4-430db293ea6d
Jun 26 05:54:33 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:34 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c07deeba-c467-4fd1-a4b3-00728bff5895 tempest-TestServerVolumeAttachmentScenario-1039778867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-43e1ed8b-eb72-449e-91f4-430db293ea6d" returned: 0 in 0.943s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c07deeba-c467-4fd1-a4b3-00728bff5895 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "cinder-quobyte-43e1ed8b-eb72-449e-91f4-430db293ea6d" released by "delete_volume" :: held 1.991s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:54:34 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-c07deeba-c467-4fd1-a4b3-00728bff5895 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Created reservations ['af8d6b19-bcd9-47e4-b8fa-3700f485cc91', 'a8314c79-c547-43f8-a600-15a4e0299730', 'fdb8889f-a149-431d-a9b6-fa2d927709ae', 'd11006f5-ad21-40c8-a258-cd253d1bde41'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:54:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c07deeba-c467-4fd1-a4b3-00728bff5895 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:54:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c07deeba-c467-4fd1-a4b3-00728bff5895 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:54:34 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c07deeba-c467-4fd1-a4b3-00728bff5895 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:54:34 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c07deeba-c467-4fd1-a4b3-00728bff5895 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:54:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c07deeba-c467-4fd1-a4b3-00728bff5895 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:54:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c07deeba-c467-4fd1-a4b3-00728bff5895 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:35 devstack sudo[106943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:54:35 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0090cee7-ef35-49a8-a4b8-352fe756bd24 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Acquiring lock "cinder-496d5827-ff8e-4c3b-aed6-214a659adc63-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:54:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0090cee7-ef35-49a8-a4b8-352fe756bd24 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "cinder-496d5827-ff8e-4c3b-aed6-214a659adc63-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:54:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0090cee7-ef35-49a8-a4b8-352fe756bd24 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Acquiring lock "cinder-quobyte-496d5827-ff8e-4c3b-aed6-214a659adc63" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:54:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0090cee7-ef35-49a8-a4b8-352fe756bd24 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "cinder-quobyte-496d5827-ff8e-4c3b-aed6-214a659adc63" acquired by "delete_volume" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:54:35 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6996c81-64a4-46b1-a567-a45c5dbcda58]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:54:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0090cee7-ef35-49a8-a4b8-352fe756bd24 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-496d5827-ff8e-4c3b-aed6-214a659adc63 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:35 devstack sudo[106945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-496d5827-ff8e-4c3b-aed6-214a659adc63
Jun 26 05:54:35 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:35 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c07deeba-c467-4fd1-a4b3-00728bff5895 tempest-TestServerVolumeAttachmentScenario-1039778867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.732s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:35 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-c07deeba-c467-4fd1-a4b3-00728bff5895 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:54:35 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-c07deeba-c467-4fd1-a4b3-00728bff5895 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Deleted volume successfully.
Jun 26 05:54:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c07deeba-c467-4fd1-a4b3-00728bff5895 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "cinder-43e1ed8b-eb72-449e-91f4-430db293ea6d-delete_volume" released by "delete_volume" :: held 3.002s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:54:36 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0090cee7-ef35-49a8-a4b8-352fe756bd24 tempest-TestServerVolumeAttachmentScenario-1039778867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-496d5827-ff8e-4c3b-aed6-214a659adc63" returned: 0 in 0.815s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0090cee7-ef35-49a8-a4b8-352fe756bd24 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-496d5827-ff8e-4c3b-aed6-214a659adc63 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:36 devstack sudo[106951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-496d5827-ff8e-4c3b-aed6-214a659adc63
Jun 26 05:54:36 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:36 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0090cee7-ef35-49a8-a4b8-352fe756bd24 tempest-TestServerVolumeAttachmentScenario-1039778867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-496d5827-ff8e-4c3b-aed6-214a659adc63" returned: 0 in 0.854s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0090cee7-ef35-49a8-a4b8-352fe756bd24 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "cinder-quobyte-496d5827-ff8e-4c3b-aed6-214a659adc63" released by "delete_volume" :: held 1.719s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:54:36 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-0090cee7-ef35-49a8-a4b8-352fe756bd24 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Created reservations ['15ba70c9-4d68-4f2c-999f-211511102c8c', '802473b8-35ca-4763-9fa1-ebbad59f93f3', '61d809a7-6ed9-49c5-a762-eabf821d7313', '8f463af2-64fa-4d37-8c51-7172cd1adf66'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:54:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0090cee7-ef35-49a8-a4b8-352fe756bd24 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:54:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0090cee7-ef35-49a8-a4b8-352fe756bd24 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:54:37 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-0090cee7-ef35-49a8-a4b8-352fe756bd24 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:54:37 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-0090cee7-ef35-49a8-a4b8-352fe756bd24 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:54:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0090cee7-ef35-49a8-a4b8-352fe756bd24 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:54:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0090cee7-ef35-49a8-a4b8-352fe756bd24 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:37 devstack sudo[106958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:54:37 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:37 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0090cee7-ef35-49a8-a4b8-352fe756bd24 tempest-TestServerVolumeAttachmentScenario-1039778867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.738s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:37 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-0090cee7-ef35-49a8-a4b8-352fe756bd24 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:54:37 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-0090cee7-ef35-49a8-a4b8-352fe756bd24 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Deleted volume successfully.
Jun 26 05:54:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0090cee7-ef35-49a8-a4b8-352fe756bd24 tempest-TestServerVolumeAttachmentScenario-1039778867 None] Lock "cinder-496d5827-ff8e-4c3b-aed6-214a659adc63-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:54:47 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=12,cinder:INSERT=4,cinder:UPDATE=16 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:54:47 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=16,cinder:SELECT=8,cinder:INSERT=4,cinder:DELETE=2 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Flow 'volume_create_manager' (d7ab99a2-0fef-48aa-bb01-12414d59691b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c931b5b7-c468-41f7-9c37-7cab08830918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c931b5b7-c468-41f7-9c37-7cab08830918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1629359511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e86ab7e-4119-4686-8353-5d6b1f22b70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84bed9b8b4ed475984b0aa2c9427d7ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:54:48Z,use_quota=True,user_id='e43a1f55a87541d885f132698206f785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ffe94b-46c1-4da3-872c-d3327032ed14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ffe94b-46c1-4da3-872c-d3327032ed14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ddcc40-ca6f-432a-adea-bc466576bef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ddcc40-ca6f-432a-adea-bc466576bef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e86ab7e-4119-4686-8353-5d6b1f22b70f', 'volume_name': 'volume-2e86ab7e-4119-4686-8353-5d6b1f22b70f', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e9e495-03fa-425e-999a-17ac3d803e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e9e495-03fa-425e-999a-17ac3d803e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae94a459-67d6-4f49-94d8-796193247f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:48 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Volume 2e86ab7e-4119-4686-8353-5d6b1f22b70f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e86ab7e-4119-4686-8353-5d6b1f22b70f', 'volume_size': 1}
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1629359511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e86ab7e-4119-4686-8353-5d6b1f22b70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84bed9b8b4ed475984b0aa2c9427d7ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:54:48Z,use_quota=True,user_id='e43a1f55a87541d885f132698206f785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Creating volume 2e86ab7e-4119-4686-8353-5d6b1f22b70f {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:54:48 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:54:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2e86ab7e-4119-4686-8353-5d6b1f22b70f 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:48 devstack sudo[107049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2e86ab7e-4119-4686-8353-5d6b1f22b70f 1073741824
Jun 26 05:54:48 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f3ca62a9-30f3-437b-80e8-cf1486092430 tempest-VolumesActionsTest-1819492261 None] Acquiring lock "cinder-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a" by "attach_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:54:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f3ca62a9-30f3-437b-80e8-cf1486092430 tempest-VolumesActionsTest-1819492261 None] Lock "cinder-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a" acquired by "attach_volume" :: waited 0.059s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:54:49 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-f3ca62a9-30f3-437b-80e8-cf1486092430 tempest-VolumesActionsTest-1819492261 None] Attaching volume 16ff5b3a-b2c3-4923-9c21-cea47ee5f17a to instance 81783942-463a-40bb-af7d-6c409d392552 at mountpoint /dev/vdb on host None.
Jun 26 05:54:49 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-f3ca62a9-30f3-437b-80e8-cf1486092430 tempest-VolumesActionsTest-1819492261 None] Attach volume completed successfully.
Jun 26 05:54:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f3ca62a9-30f3-437b-80e8-cf1486092430 tempest-VolumesActionsTest-1819492261 None] Lock "cinder-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a" released by "attach_volume" :: held 0.260s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:54:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f32b258d-7598-44a1-b579-908a445cb605 tempest-VolumesActionsTest-1819492261 None] Acquiring lock "cinder-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a-detach_volume" by "detach_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:54:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f32b258d-7598-44a1-b579-908a445cb605 tempest-VolumesActionsTest-1819492261 None] Lock "cinder-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:54:49 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-f32b258d-7598-44a1-b579-908a445cb605 tempest-VolumesActionsTest-1819492261 None] Detaching volume 16ff5b3a-b2c3-4923-9c21-cea47ee5f17a from instance 81783942-463a-40bb-af7d-6c409d392552.
Jun 26 05:54:49 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-f32b258d-7598-44a1-b579-908a445cb605 tempest-VolumesActionsTest-1819492261 None] Detach volume completed successfully.
Jun 26 05:54:49 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2e86ab7e-4119-4686-8353-5d6b1f22b70f 1073741824" returned: 0 in 1.376s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f32b258d-7598-44a1-b579-908a445cb605 tempest-VolumesActionsTest-1819492261 None] Lock "cinder-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a-detach_volume" released by "detach_volume" :: held 0.129s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:54:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2e86ab7e-4119-4686-8353-5d6b1f22b70f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:49 devstack sudo[107056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2e86ab7e-4119-4686-8353-5d6b1f22b70f
Jun 26 05:54:49 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:50 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:54:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Flow 'volume_create_manager' (343a154e-274b-4487-a603-0d4bee609234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:54:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929d5df8-803e-40ee-bf16-ceb392ef5118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929d5df8-803e-40ee-bf16-ceb392ef5118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1529536064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b569ab7-b8b9-4de0-a38c-053e712b8f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0cbd83bfdc4ab68e5d8fe83d1d940b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:54:50Z,use_quota=True,user_id='0ca6f194420348adac5eb2277164ccd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d726f8-82f5-4736-bed9-aff4eec2f2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d726f8-82f5-4736-bed9-aff4eec2f2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf8341e-9c23-426c-82b0-7d263a9bb5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf8341e-9c23-426c-82b0-7d263a9bb5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b569ab7-b8b9-4de0-a38c-053e712b8f9b', 'volume_name': 'volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5514d72-11e4-4fb9-bcee-cbab5157b928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5514d72-11e4-4fb9-bcee-cbab5157b928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:50 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffdee56-7292-475f-97fb-cefb021966b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:50 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Volume 2b569ab7-b8b9-4de0-a38c-053e712b8f9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b', 'volume_size': 1}
Jun 26 05:54:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:54:51 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2e86ab7e-4119-4686-8353-5d6b1f22b70f" returned: 0 in 1.394s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] <== create_volume: return (2822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:54:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.825s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:54:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.665s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:54:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1529536064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b569ab7-b8b9-4de0-a38c-053e712b8f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0cbd83bfdc4ab68e5d8fe83d1d940b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:54:50Z,use_quota=True,user_id='0ca6f194420348adac5eb2277164ccd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:54:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Creating volume 2b569ab7-b8b9-4de0-a38c-053e712b8f9b {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:54:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:54:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:54:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:54:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:54:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:54:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:54:51 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:54:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:51 devstack sudo[107059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b 1073741824
Jun 26 05:54:51 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae94a459-67d6-4f49-94d8-796193247f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e86ab7e-4119-4686-8353-5d6b1f22b70f', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da470e9-89b2-4105-adee-169112da2033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:51 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Volume volume-2e86ab7e-4119-4686-8353-5d6b1f22b70f (2e86ab7e-4119-4686-8353-5d6b1f22b70f): created successfully
Jun 26 05:54:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da470e9-89b2-4105-adee-169112da2033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Flow 'volume_create_manager' (d7ab99a2-0fef-48aa-bb01-12414d59691b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:54:51 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-292dd9cf-429b-478a-8fb9-f00a5d9fb00c tempest-AttachVolumeNegativeTest-1214912838 None] Created volume successfully.
Jun 26 05:54:52 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b 1073741824" returned: 0 in 1.196s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:52 devstack sudo[107106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b
Jun 26 05:54:52 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:53 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b" returned: 0 in 0.699s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:53 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:54:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:54:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffdee56-7292-475f-97fb-cefb021966b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ac5e38-7976-4d46-9b9e-2445cfa5f57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:53 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Volume volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b (2b569ab7-b8b9-4de0-a38c-053e712b8f9b): created successfully
Jun 26 05:54:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ac5e38-7976-4d46-9b9e-2445cfa5f57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:53 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Flow 'volume_create_manager' (343a154e-274b-4487-a603-0d4bee609234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:54:53 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-32d98692-3310-46bf-9a0d-2c6ba5ec9df9 tempest-SnapshotDependencyTests-700556476 None] Created volume successfully.
Jun 26 05:54:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-318d88d6-2b0d-477f-9d3d-a54269ce6024 tempest-SnapshotDependencyTests-700556476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:54:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-318d88d6-2b0d-477f-9d3d-a54269ce6024 tempest-SnapshotDependencyTests-700556476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:54:53 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-318d88d6-2b0d-477f-9d3d-a54269ce6024 tempest-SnapshotDependencyTests-700556476 None] Creating offline snapshot d302ed45-f605-4681-a583-dbe710ff1b45 of volume 2b569ab7-b8b9-4de0-a38c-053e712b8f9b {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:54:53 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[122bb288-7d21-404f-8d40-103e9daa5513]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:54:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-318d88d6-2b0d-477f-9d3d-a54269ce6024 tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:54 devstack sudo[107113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b
Jun 26 05:54:54 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:54 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-318d88d6-2b0d-477f-9d3d-a54269ce6024 tempest-SnapshotDependencyTests-700556476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b" returned: 0 in 0.968s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-318d88d6-2b0d-477f-9d3d-a54269ce6024 tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:54 devstack sudo[107119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45 1G
Jun 26 05:54:54 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-cc5b3203-8844-48c2-aea1-1af6c478c637 req-a1922765-0185-44ec-bc98-2e608b3ab3f5 tempest-AttachVolumeNegativeTest-1214912838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:54:55 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-318d88d6-2b0d-477f-9d3d-a54269ce6024 tempest-SnapshotDependencyTests-700556476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45 1G" returned: 0 in 0.952s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-318d88d6-2b0d-477f-9d3d-a54269ce6024 tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:55 devstack sudo[107133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45
Jun 26 05:54:55 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:56 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:54:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Flow 'volume_create_manager' (7befe751-2078-48ca-8c3d-05951a796b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:54:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdad6414-f0ae-4f40-99a3-5780354563eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdad6414-f0ae-4f40-99a3-5780354563eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2058075227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=235cbf00-fe59-4628-83d6-b6f7f7c5a588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc0732020804d58aba1a968f078e995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:54:56Z,use_quota=True,user_id='8f9fa90e42294fd8bd5a7abfd52defee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d5d48b-3d7c-47ec-b35e-85629fd211b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d5d48b-3d7c-47ec-b35e-85629fd211b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b45df4e-8e94-40d7-ac2c-0465d4e6f7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b45df4e-8e94-40d7-ac2c-0465d4e6f7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '235cbf00-fe59-4628-83d6-b6f7f7c5a588', 'volume_name': 'volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96c718d-7d38-49cc-8da6-4d3a42a73b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96c718d-7d38-49cc-8da6-4d3a42a73b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:54:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470b2bc6-cc74-43d4-a34c-2027156dff97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:54:56 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Volume 235cbf00-fe59-4628-83d6-b6f7f7c5a588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588', 'volume_size': 1}
Jun 26 05:54:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:54:56 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-318d88d6-2b0d-477f-9d3d-a54269ce6024 tempest-SnapshotDependencyTests-700556476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45" returned: 0 in 0.704s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:56 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-318d88d6-2b0d-477f-9d3d-a54269ce6024 tempest-SnapshotDependencyTests-700556476 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45 is being set with open permissions: ugo+rw
Jun 26 05:54:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-318d88d6-2b0d-477f-9d3d-a54269ce6024 tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:56 devstack sudo[107138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45
Jun 26 05:54:56 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:57 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-318d88d6-2b0d-477f-9d3d-a54269ce6024 tempest-SnapshotDependencyTests-700556476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45" returned: 0 in 0.649s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-318d88d6-2b0d-477f-9d3d-a54269ce6024 tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:57 devstack sudo[107141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.info
Jun 26 05:54:57 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:57 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-318d88d6-2b0d-477f-9d3d-a54269ce6024 tempest-SnapshotDependencyTests-700556476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.info" returned: 0 in 0.640s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:57 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-318d88d6-2b0d-477f-9d3d-a54269ce6024 tempest-SnapshotDependencyTests-700556476 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.info is being set with open permissions: ugo+rw
Jun 26 05:54:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-318d88d6-2b0d-477f-9d3d-a54269ce6024 tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:57 devstack sudo[107144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.info
Jun 26 05:54:57 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:58 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-318d88d6-2b0d-477f-9d3d-a54269ce6024 tempest-SnapshotDependencyTests-700556476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.info" returned: 0 in 0.648s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-318d88d6-2b0d-477f-9d3d-a54269ce6024 tempest-SnapshotDependencyTests-700556476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.679s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:54:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-cc5b3203-8844-48c2-aea1-1af6c478c637 req-a1922765-0185-44ec-bc98-2e608b3ab3f5 tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.820s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:54:58 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[55934ec9-23bf-47f3-959a-446cd2fb1525]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:54:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-cc5b3203-8844-48c2-aea1-1af6c478c637 req-a1922765-0185-44ec-bc98-2e608b3ab3f5 tempest-AttachVolumeNegativeTest-1214912838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2e86ab7e-4119-4686-8353-5d6b1f22b70f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:58 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-318d88d6-2b0d-477f-9d3d-a54269ce6024 tempest-SnapshotDependencyTests-700556476 None] Create snapshot completed successfully
Jun 26 05:54:58 devstack sudo[107147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2e86ab7e-4119-4686-8353-5d6b1f22b70f
Jun 26 05:54:58 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:59 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root
Jun 26 05:54:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-cc5b3203-8844-48c2-aea1-1af6c478c637 req-a1922765-0185-44ec-bc98-2e608b3ab3f5 tempest-AttachVolumeNegativeTest-1214912838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2e86ab7e-4119-4686-8353-5d6b1f22b70f" returned: 0 in 0.767s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:54:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-cc5b3203-8844-48c2-aea1-1af6c478c637 req-a1922765-0185-44ec-bc98-2e608b3ab3f5 tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.788s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:54:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.955s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:54:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2058075227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=235cbf00-fe59-4628-83d6-b6f7f7c5a588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc0732020804d58aba1a968f078e995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:54:56Z,use_quota=True,user_id='8f9fa90e42294fd8bd5a7abfd52defee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:54:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Creating volume 235cbf00-fe59-4628-83d6-b6f7f7c5a588 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:54:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:54:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:54:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:54:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:54:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:54:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:54:59 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:54:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:54:59 devstack sudo[107153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588 1073741824
Jun 26 05:54:59 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:54:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-cc5b3203-8844-48c2-aea1-1af6c478c637 req-a1922765-0185-44ec-bc98-2e608b3ab3f5 tempest-AttachVolumeNegativeTest-1214912838 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85', 'name': 'volume-2e86ab7e-4119-4686-8353-5d6b1f22b70f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6eeef00a-c0d8-4811-b123-ce9ca5790607', 'enforce_multipath': True} {{(pid=93708) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 05:54:59 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-cc5b3203-8844-48c2-aea1-1af6c478c637 req-a1922765-0185-44ec-bc98-2e608b3ab3f5 tempest-AttachVolumeNegativeTest-1214912838 None] attachment_update completed successfully.
Jun 26 05:54:59 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:54:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Flow 'volume_create_manager' (39113a6a-3fab-4c0d-b095-8a6920864681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:55:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca3e05e-cac7-41c0-b643-81207861c0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca3e05e-cac7-41c0-b643-81207861c0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e49a87a-6616-43be-8360-e43666e2fafd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0cbd83bfdc4ab68e5d8fe83d1d940b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d302ed45-f605-4681-a583-dbe710ff1b45,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:55:00Z,use_quota=True,user_id='0ca6f194420348adac5eb2277164ccd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b08d5c2-5455-4b98-9a70-7695f3a3bb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b08d5c2-5455-4b98-9a70-7695f3a3bb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe27adc-c2c5-4ec0-ac21-7e00017f87c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe27adc-c2c5-4ec0-ac21-7e00017f87c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1e49a87a-6616-43be-8360-e43666e2fafd', 'volume_name': 'volume-1e49a87a-6616-43be-8360-e43666e2fafd', 'volume_size': 1, 'snapshot_id': 'd302ed45-f605-4681-a583-dbe710ff1b45'}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac5be98-4668-4c1f-9917-b9c338508eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac5be98-4668-4c1f-9917-b9c338508eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec17a6f-de18-4349-bdc6-f006891239e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:00 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Volume 1e49a87a-6616-43be-8360-e43666e2fafd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1e49a87a-6616-43be-8360-e43666e2fafd', 'volume_size': 1, 'snapshot_id': 'd302ed45-f605-4681-a583-dbe710ff1b45'}
Jun 26 05:55:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:00 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588 1073741824" returned: 0 in 1.022s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:00 devstack sudo[107233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588
Jun 26 05:55:00 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:01 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588" returned: 0 in 0.732s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.043s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Acquiring lock "cinder-quobyte-d302ed45-f605-4681-a583-dbe710ff1b45-1e49a87a-6616-43be-8360-e43666e2fafd" by "_create_volume_from_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470b2bc6-cc74-43d4-a34c-2027156dff97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b130d68-bbf2-4efb-aa0a-222bd536174a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Lock "cinder-quobyte-d302ed45-f605-4681-a583-dbe710ff1b45-1e49a87a-6616-43be-8360-e43666e2fafd" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Creating volume 1e49a87a-6616-43be-8360-e43666e2fafd from snapshot d302ed45-f605-4681-a583-dbe710ff1b45 {{(pid=93708) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Acquiring lock "cinder-quobyte-1e49a87a-6616-43be-8360-e43666e2fafd" by "_copy_volume_from_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:01 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Volume volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588 (235cbf00-fe59-4628-83d6-b6f7f7c5a588): created successfully
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b130d68-bbf2-4efb-aa0a-222bd536174a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Flow 'volume_create_manager' (7befe751-2078-48ca-8c3d-05951a796b7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Lock "cinder-quobyte-1e49a87a-6616-43be-8360-e43666e2fafd" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] snapshot: d302ed45-f605-4681-a583-dbe710ff1b45, volume: 1e49a87a-6616-43be-8360-e43666e2fafd,  {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:01 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-2f29bb18-449d-48c5-be17-3ae687a735d9 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Created volume successfully.
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe4db95-7816-4099-9446-29d64a5832a8]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:55:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:01 devstack sudo[107883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45
Jun 26 05:55:01 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:02 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45" returned: 0 in 0.778s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:55:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 05:55:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Creating direct copy from snapshot {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 05:55:02 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac74ecd1-cb31-4a0a-a5de-6c6ad19c6d7b]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:55:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-259e5635-5ef8-4df6-a8a5-a98db713573e tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:02 devstack sudo[107893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b
Jun 26 05:55:02 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:02 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b" returned: 0 in 0.798s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:02 devstack cinder-volume[93708]: DEBUG cinder.utils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Path /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1e49a87a-6616-43be-8360-e43666e2fafd not found in is_blk_device check {{(pid=93708) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 05:55:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1e49a87a-6616-43be-8360-e43666e2fafd {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:02 devstack sudo[107898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1e49a87a-6616-43be-8360-e43666e2fafd
Jun 26 05:55:02 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:08 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-25d6bb65-3bc5-4e49-94cc-57dfedbac911 req-a610cbbf-7a5e-4e38-aa02-590a130a7436 tempest-AttachVolumeNegativeTest-1214912838 None] Terminate volume connection completed successfully.
Jun 26 05:55:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-25d6bb65-3bc5-4e49-94cc-57dfedbac911 req-a610cbbf-7a5e-4e38-aa02-590a130a7436 tempest-AttachVolumeNegativeTest-1214912838 None] Deleting attachment 6eeef00a-c0d8-4811-b123-ce9ca5790607. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 05:55:09 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1e49a87a-6616-43be-8360-e43666e2fafd" returned: 0 in 6.687s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:09 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e53ad3-e472-4b49-9fbd-0169d2a877e4]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:55:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:09 devstack sudo[107972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b
Jun 26 05:55:09 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:10 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b" returned: 0 in 0.960s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:10 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Image conversion details: src /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b, size 1024.00 MB, duration 6.69 sec, destination /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1e49a87a-6616-43be-8360-e43666e2fafd {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 05:55:10 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Converted 1024.00 MB image at 153.08 MB/s
Jun 26 05:55:10 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1e49a87a-6616-43be-8360-e43666e2fafd is being set with open permissions: ugo+rw
Jun 26 05:55:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1e49a87a-6616-43be-8360-e43666e2fafd {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:10 devstack sudo[107977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1e49a87a-6616-43be-8360-e43666e2fafd
Jun 26 05:55:10 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:55:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:55:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:55:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:10 devstack sudo[107979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:55:10 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:11 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1e49a87a-6616-43be-8360-e43666e2fafd" returned: 0 in 0.674s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Lock "cinder-quobyte-1e49a87a-6616-43be-8360-e43666e2fafd" released by "_copy_volume_from_snapshot" :: held 10.003s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Lock "cinder-quobyte-d302ed45-f605-4681-a583-dbe710ff1b45-1e49a87a-6616-43be-8360-e43666e2fafd" released by "_create_volume_from_snapshot" :: held 10.055s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.088s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-259e5635-5ef8-4df6-a8a5-a98db713573e tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.048s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-259e5635-5ef8-4df6-a8a5-a98db713573e tempest-CreateVolumesFromSnapshotTest-1222607117 None] Creating offline snapshot a028f2b8-c58f-4ced-a9f8-1ae8935602e4 of volume 235cbf00-fe59-4628-83d6-b6f7f7c5a588 {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:55:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec17a6f-de18-4349-bdc6-f006891239e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e49a87a-6616-43be-8360-e43666e2fafd', 'volume_size': 1, 'snapshot_id': 'd302ed45-f605-4681-a583-dbe710ff1b45'}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686210d4-3644-44d8-a3b0-abb85a23e6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:11 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[65efcf96-9cae-4e60-a870-179c2252a2dc]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:55:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-259e5635-5ef8-4df6-a8a5-a98db713573e tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:11 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Volume volume-1e49a87a-6616-43be-8360-e43666e2fafd (1e49a87a-6616-43be-8360-e43666e2fafd): created successfully
Jun 26 05:55:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686210d4-3644-44d8-a3b0-abb85a23e6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Flow 'volume_create_manager' (39113a6a-3fab-4c0d-b095-8a6920864681) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:55:11 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-dd61a68e-ee6f-46fe-a48d-ddcba20762cd tempest-SnapshotDependencyTests-700556476 None] Created volume successfully.
Jun 26 05:55:11 devstack sudo[107983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588
Jun 26 05:55:11 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:11 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.739s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:11 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:55:11 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:55:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 28 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:55:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>, <Thread(tpool_thread_0, started daemon 124035494721216)>, <Thread(tpool_thread_1, started daemon 124035486328512)>, <Thread(tpool_thread_2, started daemon 124035477919424)>, <Thread(tpool_thread_3, started daemon 124035469510336)>, <Thread(tpool_thread_4, started daemon 124035461101248)>, <Thread(tpool_thread_5, started daemon 124035452692160)>, <Thread(tpool_thread_6, started daemon 124035444283072)>, <Thread(tpool_thread_7, started daemon 124035435873984)>, <Thread(tpool_thread_8, started daemon 124035427464896)>, <Thread(tpool_thread_9, started daemon 124035419055808)>, <Thread(tpool_thread_10, started daemon 124035410646720)>, <Thread(tpool_thread_11, started daemon 124035402237632)>, <Thread(tpool_thread_12, started daemon 124035393828544)>, <Thread(tpool_thread_13, started daemon 124035385419456)>, <Thread(tpool_thread_14, started daemon 124035377010368)>, <Thread(tpool_thread_15, started daemon 124035368601280)>, <Thread(tpool_thread_16, started daemon 124035360192192)>, <Thread(tpool_thread_17, started daemon 124035351783104)>, <Thread(tpool_thread_18, started daemon 124035343374016)>, <Thread(tpool_thread_19, started daemon 124035334964928)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:55:12 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-259e5635-5ef8-4df6-a8a5-a98db713573e tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588" returned: 0 in 1.042s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-259e5635-5ef8-4df6-a8a5-a98db713573e tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.a028f2b8-c58f-4ced-a9f8-1ae8935602e4 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:12 devstack sudo[108102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.a028f2b8-c58f-4ced-a9f8-1ae8935602e4 1G
Jun 26 05:55:12 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:12 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] Acquiring lock "cinder-d302ed45-f605-4681-a583-dbe710ff1b45-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:12 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] Lock "cinder-d302ed45-f605-4681-a583-dbe710ff1b45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:12 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] Acquiring lock "cinder-quobyte-2b569ab7-b8b9-4de0-a38c-053e712b8f9b" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:12 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] Lock "cinder-quobyte-2b569ab7-b8b9-4de0-a38c-053e712b8f9b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:12 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] Acquiring lock "cinder-quobyte-d302ed45-f605-4681-a583-dbe710ff1b45" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:12 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] Lock "cinder-quobyte-d302ed45-f605-4681-a583-dbe710ff1b45" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:12 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] Deleting offline snapshot d302ed45-f605-4681-a583-dbe710ff1b45 of volume 2b569ab7-b8b9-4de0-a38c-053e712b8f9b {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:55:12 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] snapshot_file for this snap is: volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:55:12 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd769d8-fc05-49d1-aca8-859c46f04043]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:55:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:12 devstack sudo[108119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45
Jun 26 05:55:12 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:13 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-259e5635-5ef8-4df6-a8a5-a98db713573e tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.a028f2b8-c58f-4ced-a9f8-1ae8935602e4 1G" returned: 0 in 0.978s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-259e5635-5ef8-4df6-a8a5-a98db713573e tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.a028f2b8-c58f-4ced-a9f8-1ae8935602e4 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:13 devstack sudo[108137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.a028f2b8-c58f-4ced-a9f8-1ae8935602e4
Jun 26 05:55:13 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:13 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45" returned: 0 in 0.993s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:13 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:55:13 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa3481b-9a1b-4742-a1b5-cc71c1a86bb7]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:55:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:13 devstack sudo[108143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b
Jun 26 05:55:13 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:14 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-259e5635-5ef8-4df6-a8a5-a98db713573e tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.a028f2b8-c58f-4ced-a9f8-1ae8935602e4" returned: 0 in 0.775s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:14 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-259e5635-5ef8-4df6-a8a5-a98db713573e tempest-CreateVolumesFromSnapshotTest-1222607117 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.a028f2b8-c58f-4ced-a9f8-1ae8935602e4 is being set with open permissions: ugo+rw
Jun 26 05:55:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-259e5635-5ef8-4df6-a8a5-a98db713573e tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.a028f2b8-c58f-4ced-a9f8-1ae8935602e4 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:14 devstack sudo[108150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.a028f2b8-c58f-4ced-a9f8-1ae8935602e4
Jun 26 05:55:14 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:14 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b" returned: 0 in 0.982s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:14 devstack sudo[108164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45
Jun 26 05:55:14 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:14 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-259e5635-5ef8-4df6-a8a5-a98db713573e tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.a028f2b8-c58f-4ced-a9f8-1ae8935602e4" returned: 0 in 0.784s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-259e5635-5ef8-4df6-a8a5-a98db713573e tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:14 devstack sudo[108171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.info
Jun 26 05:55:14 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:15 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45" returned: 0 in 1.201s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:16 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:16 devstack sudo[108233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45
Jun 26 05:55:16 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-259e5635-5ef8-4df6-a8a5-a98db713573e tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.info" returned: 0 in 1.089s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:16 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-259e5635-5ef8-4df6-a8a5-a98db713573e tempest-CreateVolumesFromSnapshotTest-1222607117 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.info is being set with open permissions: ugo+rw
Jun 26 05:55:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-259e5635-5ef8-4df6-a8a5-a98db713573e tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:16 devstack sudo[108236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.info
Jun 26 05:55:16 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:16 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b.d302ed45-f605-4681-a583-dbe710ff1b45" returned: 0 in 0.957s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:16 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] Lock "cinder-quobyte-d302ed45-f605-4681-a583-dbe710ff1b45" released by "_delete_snapshot" :: held 4.308s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] Lock "cinder-quobyte-2b569ab7-b8b9-4de0-a38c-053e712b8f9b" released by "delete_snapshot" :: held 4.336s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-259e5635-5ef8-4df6-a8a5-a98db713573e tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.info" returned: 0 in 0.974s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-259e5635-5ef8-4df6-a8a5-a98db713573e tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.776s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:17 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-259e5635-5ef8-4df6-a8a5-a98db713573e tempest-CreateVolumesFromSnapshotTest-1222607117 None] Create snapshot completed successfully
Jun 26 05:55:17 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] Created reservations ['1a901701-41b0-4150-a1bd-6e4e5e38a8ab', '9deb9656-6efa-473b-936e-b39fab644da6', '69228ab1-7b1e-47b4-a1cb-e92fa1a4123e', '750f98a0-f58c-4cd4-aab4-f899c22c97ea'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:55:17 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] Delete snapshot completed successfully.
Jun 26 05:55:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-fde084a5-2c6c-4d96-bead-51674f6727dc tempest-SnapshotDependencyTests-700556476 None] Lock "cinder-d302ed45-f605-4681-a583-dbe710ff1b45-delete_snapshot" released by "delete_snapshot" :: held 4.531s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5d72bb74-3fd7-4bc4-9477-b22131ea6336 tempest-SnapshotDependencyTests-700556476 None] Acquiring lock "cinder-2b569ab7-b8b9-4de0-a38c-053e712b8f9b-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5d72bb74-3fd7-4bc4-9477-b22131ea6336 tempest-SnapshotDependencyTests-700556476 None] Lock "cinder-2b569ab7-b8b9-4de0-a38c-053e712b8f9b-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Flow 'volume_create_manager' (2abbcf67-7873-41ab-a9f8-2f5afd810d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f77147-2495-4e83-be2d-43b27d654bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f77147-2495-4e83-be2d-43b27d654bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-893559366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e142072b-13eb-4f10-86dc-d9d3c310c192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc0732020804d58aba1a968f078e995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:55:18Z,use_quota=True,user_id='8f9fa90e42294fd8bd5a7abfd52defee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eedad15-e781-4d8d-ad89-5196388b0c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eedad15-e781-4d8d-ad89-5196388b0c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f67fa03-3652-4472-983d-0f81baaab8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f67fa03-3652-4472-983d-0f81baaab8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e142072b-13eb-4f10-86dc-d9d3c310c192', 'volume_name': 'volume-e142072b-13eb-4f10-86dc-d9d3c310c192', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73fe2707-494d-47cf-bf4d-68fc8de56dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73fe2707-494d-47cf-bf4d-68fc8de56dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4764fe3-bc5e-464d-a62e-09fccb6ad44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:18 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Volume e142072b-13eb-4f10-86dc-d9d3c310c192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e142072b-13eb-4f10-86dc-d9d3c310c192', 'volume_size': 1}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-893559366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e142072b-13eb-4f10-86dc-d9d3c310c192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc0732020804d58aba1a968f078e995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:55:18Z,use_quota=True,user_id='8f9fa90e42294fd8bd5a7abfd52defee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Creating volume e142072b-13eb-4f10-86dc-d9d3c310c192 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:55:18 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e142072b-13eb-4f10-86dc-d9d3c310c192 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5d72bb74-3fd7-4bc4-9477-b22131ea6336 tempest-SnapshotDependencyTests-700556476 None] Acquiring lock "cinder-quobyte-2b569ab7-b8b9-4de0-a38c-053e712b8f9b" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:18 devstack sudo[108253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e142072b-13eb-4f10-86dc-d9d3c310c192 1073741824
Jun 26 05:55:18 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5d72bb74-3fd7-4bc4-9477-b22131ea6336 tempest-SnapshotDependencyTests-700556476 None] Lock "cinder-quobyte-2b569ab7-b8b9-4de0-a38c-053e712b8f9b" acquired by "delete_volume" :: waited 0.064s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b08d6a-c20e-46c1-9d0a-add81d4d7d28]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5d72bb74-3fd7-4bc4-9477-b22131ea6336 tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:18 devstack sudo[108256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b
Jun 26 05:55:18 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:18 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:55:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Flow 'volume_create_manager' (1ac4dd86-b159-4de3-a731-1c3adca2964d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:55:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db73536a-ed41-4bae-9b65-dae141b59840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db73536a-ed41-4bae-9b65-dae141b59840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-290414441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cae848c-e6da-4051-967e-f2d8e6e500b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc0732020804d58aba1a968f078e995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:55:19Z,use_quota=True,user_id='8f9fa90e42294fd8bd5a7abfd52defee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa9df559-6840-415e-ada2-676d73b692ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa9df559-6840-415e-ada2-676d73b692ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e232eb3e-e665-4088-b8d0-6939f25cb97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e232eb3e-e665-4088-b8d0-6939f25cb97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cae848c-e6da-4051-967e-f2d8e6e500b9', 'volume_name': 'volume-1cae848c-e6da-4051-967e-f2d8e6e500b9', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5adb65e3-3d4e-4fa4-94c5-b41dc597dfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5adb65e3-3d4e-4fa4-94c5-b41dc597dfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca2447b-bf74-480c-bee2-063317a14e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:19 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Volume 1cae848c-e6da-4051-967e-f2d8e6e500b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cae848c-e6da-4051-967e-f2d8e6e500b9', 'volume_size': 1}
Jun 26 05:55:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2c4eabeb-28e5-4e07-9caa-c08cae6093a6 tempest-VolumesActionsTest-1819492261 None] Acquiring lock "cinder-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a" by "attach_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2c4eabeb-28e5-4e07-9caa-c08cae6093a6 tempest-VolumesActionsTest-1819492261 None] Lock "cinder-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a" acquired by "attach_volume" :: waited 0.039s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:19 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-2c4eabeb-28e5-4e07-9caa-c08cae6093a6 tempest-VolumesActionsTest-1819492261 None] Attaching volume 16ff5b3a-b2c3-4923-9c21-cea47ee5f17a to instance f67b5db6-7823-4aad-8d4c-2961d04ca90c at mountpoint /dev/vdb on host None.
Jun 26 05:55:19 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-2c4eabeb-28e5-4e07-9caa-c08cae6093a6 tempest-VolumesActionsTest-1819492261 None] Attach volume completed successfully.
Jun 26 05:55:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2c4eabeb-28e5-4e07-9caa-c08cae6093a6 tempest-VolumesActionsTest-1819492261 None] Lock "cinder-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a" released by "attach_volume" :: held 0.331s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:19 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:55:20 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Flow 'volume_create_manager' (c57cdf68-e91a-4b98-821d-1ac8de01b1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:55:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (723153f0-5b62-44ef-abf6-b5d9bc7027d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e142072b-13eb-4f10-86dc-d9d3c310c192 1073741824" returned: 0 in 1.734s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:20 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-40fc10da-fe85-410c-be88-7b2ff1457064 tempest-VolumesActionsTest-1819492261 None] Acquiring lock "cinder-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a-detach_volume" by "detach_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (723153f0-5b62-44ef-abf6-b5d9bc7027d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-595543759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783fa02e-05e8-4081-ab72-1d49f98b9c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc0732020804d58aba1a968f078e995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:55:20Z,use_quota=True,user_id='8f9fa90e42294fd8bd5a7abfd52defee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c44dbb6-7f23-4370-ab51-fe8f8f71aa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c44dbb6-7f23-4370-ab51-fe8f8f71aa83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435f0b15-3d75-44ed-951d-e6fceb5c19b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435f0b15-3d75-44ed-951d-e6fceb5c19b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '783fa02e-05e8-4081-ab72-1d49f98b9c9d', 'volume_name': 'volume-783fa02e-05e8-4081-ab72-1d49f98b9c9d', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f1c2f2d-27cb-4956-909b-29792b648cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f1c2f2d-27cb-4956-909b-29792b648cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9570c38-c660-442e-b86b-2b4c39d8d7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:20 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Volume 783fa02e-05e8-4081-ab72-1d49f98b9c9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-783fa02e-05e8-4081-ab72-1d49f98b9c9d', 'volume_size': 1}
Jun 26 05:55:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:20 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-40fc10da-fe85-410c-be88-7b2ff1457064 tempest-VolumesActionsTest-1819492261 None] Lock "cinder-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a-detach_volume" acquired by "detach_volume" :: waited 0.090s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:20 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-40fc10da-fe85-410c-be88-7b2ff1457064 tempest-VolumesActionsTest-1819492261 None] Detaching volume 16ff5b3a-b2c3-4923-9c21-cea47ee5f17a from instance f67b5db6-7823-4aad-8d4c-2961d04ca90c.
Jun 26 05:55:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e142072b-13eb-4f10-86dc-d9d3c310c192 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:20 devstack sudo[108263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e142072b-13eb-4f10-86dc-d9d3c310c192
Jun 26 05:55:20 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:20 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-40fc10da-fe85-410c-be88-7b2ff1457064 tempest-VolumesActionsTest-1819492261 None] Detach volume completed successfully.
Jun 26 05:55:20 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-40fc10da-fe85-410c-be88-7b2ff1457064 tempest-VolumesActionsTest-1819492261 None] Lock "cinder-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a-detach_volume" released by "detach_volume" :: held 0.171s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:20 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5d72bb74-3fd7-4bc4-9477-b22131ea6336 tempest-SnapshotDependencyTests-700556476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b" returned: 0 in 2.020s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5d72bb74-3fd7-4bc4-9477-b22131ea6336 tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:20 devstack sudo[108267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b
Jun 26 05:55:20 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Flow 'volume_create_manager' (b72783c0-1d42-4510-be6e-7d50bcb21550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82dec16e-8307-4407-97ca-a1af6dec94df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82dec16e-8307-4407-97ca-a1af6dec94df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1583873751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3edbe87-c22e-4732-8735-a341874dd3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc0732020804d58aba1a968f078e995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:55:21Z,use_quota=True,user_id='8f9fa90e42294fd8bd5a7abfd52defee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49f5bd8-a6b8-4e79-82bd-2cdc0bb57260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49f5bd8-a6b8-4e79-82bd-2cdc0bb57260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4983c8dd-5215-43af-af88-ea09b5b669d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4983c8dd-5215-43af-af88-ea09b5b669d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3edbe87-c22e-4732-8735-a341874dd3e3', 'volume_name': 'volume-a3edbe87-c22e-4732-8735-a341874dd3e3', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5df74ec-c2f4-48f6-ab42-40027e8de90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5df74ec-c2f4-48f6-ab42-40027e8de90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c667f1b3-3efe-40b8-8715-f0eeae131c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:21 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Volume a3edbe87-c22e-4732-8735-a341874dd3e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3edbe87-c22e-4732-8735-a341874dd3e3', 'volume_size': 1}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Flow 'volume_create_manager' (90b6ffad-1aa5-4c5a-b933-0680b82a5f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b804f8-640b-4310-b879-4cad370fe1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b804f8-640b-4310-b879-4cad370fe1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-38470683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0adee59a-5b5b-4f66-8475-0f9dfd90635c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc0732020804d58aba1a968f078e995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:55:22Z,use_quota=True,user_id='8f9fa90e42294fd8bd5a7abfd52defee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bfb963d-2110-40dc-a48f-f578fa4f76d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bfb963d-2110-40dc-a48f-f578fa4f76d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2fa479-b517-447f-9b0b-616270d142bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2fa479-b517-447f-9b0b-616270d142bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0adee59a-5b5b-4f66-8475-0f9dfd90635c', 'volume_name': 'volume-0adee59a-5b5b-4f66-8475-0f9dfd90635c', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaecd164-23ff-4dc8-b1dd-7ca0f02e93d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaecd164-23ff-4dc8-b1dd-7ca0f02e93d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e231a9-bf8f-4eaf-b02a-eda6070bd48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:21 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Volume 0adee59a-5b5b-4f66-8475-0f9dfd90635c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0adee59a-5b5b-4f66-8475-0f9dfd90635c', 'volume_size': 1}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:21 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e142072b-13eb-4f10-86dc-d9d3c310c192" returned: 0 in 1.581s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] <== create_volume: return (3472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.475s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.591s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-290414441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cae848c-e6da-4051-967e-f2d8e6e500b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc0732020804d58aba1a968f078e995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:55:19Z,use_quota=True,user_id='8f9fa90e42294fd8bd5a7abfd52defee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Creating volume 1cae848c-e6da-4051-967e-f2d8e6e500b9 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:55:21 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1cae848c-e6da-4051-967e-f2d8e6e500b9 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4764fe3-bc5e-464d-a62e-09fccb6ad44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e142072b-13eb-4f10-86dc-d9d3c310c192', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ec1580-f5df-4498-9564-bcfac4e61b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:21 devstack sudo[108271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1cae848c-e6da-4051-967e-f2d8e6e500b9 1073741824
Jun 26 05:55:21 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:21 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Volume volume-e142072b-13eb-4f10-86dc-d9d3c310c192 (e142072b-13eb-4f10-86dc-d9d3c310c192): created successfully
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ec1580-f5df-4498-9564-bcfac4e61b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Flow 'volume_create_manager' (2abbcf67-7873-41ab-a9f8-2f5afd810d28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:55:21 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-936ad126-289b-4d95-8dda-768d85b8fa33 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Created volume successfully.
Jun 26 05:55:22 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5d72bb74-3fd7-4bc4-9477-b22131ea6336 tempest-SnapshotDependencyTests-700556476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2b569ab7-b8b9-4de0-a38c-053e712b8f9b" returned: 0 in 1.429s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:22 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5d72bb74-3fd7-4bc4-9477-b22131ea6336 tempest-SnapshotDependencyTests-700556476 None] Lock "cinder-quobyte-2b569ab7-b8b9-4de0-a38c-053e712b8f9b" released by "delete_volume" :: held 3.614s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:22 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-5d72bb74-3fd7-4bc4-9477-b22131ea6336 tempest-SnapshotDependencyTests-700556476 None] Created reservations ['163fb5ae-8a40-4037-ab32-1f0b89f85780', '50bf809b-6880-4b2e-87e1-cf3d53645927', 'fba6b021-05e4-4877-8939-f331a98938b1', '8eba046b-57c2-4d82-b8f9-01443ed83919'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:55:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-5d72bb74-3fd7-4bc4-9477-b22131ea6336 tempest-SnapshotDependencyTests-700556476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-5d72bb74-3fd7-4bc4-9477-b22131ea6336 tempest-SnapshotDependencyTests-700556476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:22 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-5d72bb74-3fd7-4bc4-9477-b22131ea6336 tempest-SnapshotDependencyTests-700556476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:55:22 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-5d72bb74-3fd7-4bc4-9477-b22131ea6336 tempest-SnapshotDependencyTests-700556476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:55:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-5d72bb74-3fd7-4bc4-9477-b22131ea6336 tempest-SnapshotDependencyTests-700556476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5d72bb74-3fd7-4bc4-9477-b22131ea6336 tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:22 devstack sudo[108281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:55:22 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:23 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1cae848c-e6da-4051-967e-f2d8e6e500b9 1073741824" returned: 0 in 1.344s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1cae848c-e6da-4051-967e-f2d8e6e500b9 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:23 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-91b531cf-0060-4910-86d2-d29f41a9bf47 tempest-SnapshotDependencyTests-700556476 None] Acquiring lock "cinder-1e49a87a-6616-43be-8360-e43666e2fafd-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:23 devstack sudo[108321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1cae848c-e6da-4051-967e-f2d8e6e500b9
Jun 26 05:55:23 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:23 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-91b531cf-0060-4910-86d2-d29f41a9bf47 tempest-SnapshotDependencyTests-700556476 None] Lock "cinder-1e49a87a-6616-43be-8360-e43666e2fafd-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:23 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-91b531cf-0060-4910-86d2-d29f41a9bf47 tempest-SnapshotDependencyTests-700556476 None] Acquiring lock "cinder-quobyte-1e49a87a-6616-43be-8360-e43666e2fafd" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:23 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-91b531cf-0060-4910-86d2-d29f41a9bf47 tempest-SnapshotDependencyTests-700556476 None] Lock "cinder-quobyte-1e49a87a-6616-43be-8360-e43666e2fafd" acquired by "delete_volume" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:23 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55d9aad-1b27-4e4c-841a-c7755872cedb]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:55:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-91b531cf-0060-4910-86d2-d29f41a9bf47 tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1e49a87a-6616-43be-8360-e43666e2fafd {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:23 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5d72bb74-3fd7-4bc4-9477-b22131ea6336 tempest-SnapshotDependencyTests-700556476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.199s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:23 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-5d72bb74-3fd7-4bc4-9477-b22131ea6336 tempest-SnapshotDependencyTests-700556476 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:55:23 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-5d72bb74-3fd7-4bc4-9477-b22131ea6336 tempest-SnapshotDependencyTests-700556476 None] Deleted volume successfully.
Jun 26 05:55:23 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5d72bb74-3fd7-4bc4-9477-b22131ea6336 tempest-SnapshotDependencyTests-700556476 None] Lock "cinder-2b569ab7-b8b9-4de0-a38c-053e712b8f9b-delete_volume" released by "delete_volume" :: held 5.466s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:23 devstack sudo[108324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1e49a87a-6616-43be-8360-e43666e2fafd
Jun 26 05:55:23 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:24 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1cae848c-e6da-4051-967e-f2d8e6e500b9" returned: 0 in 0.865s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] <== create_volume: return (2292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:55:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.294s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.948s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-595543759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783fa02e-05e8-4081-ab72-1d49f98b9c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc0732020804d58aba1a968f078e995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:55:20Z,use_quota=True,user_id='8f9fa90e42294fd8bd5a7abfd52defee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:55:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Creating volume 783fa02e-05e8-4081-ab72-1d49f98b9c9d {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:55:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:55:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:55:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:55:24 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:55:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-783fa02e-05e8-4081-ab72-1d49f98b9c9d 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca2447b-bf74-480c-bee2-063317a14e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cae848c-e6da-4051-967e-f2d8e6e500b9', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:24 devstack sudo[108329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-783fa02e-05e8-4081-ab72-1d49f98b9c9d 1073741824
Jun 26 05:55:24 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77fca0b1-8531-4590-9a4c-da005b6701a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:24 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Volume volume-1cae848c-e6da-4051-967e-f2d8e6e500b9 (1cae848c-e6da-4051-967e-f2d8e6e500b9): created successfully
Jun 26 05:55:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77fca0b1-8531-4590-9a4c-da005b6701a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Flow 'volume_create_manager' (1ac4dd86-b159-4de3-a731-1c3adca2964d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:55:24 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-9b9d496e-f48e-427a-ab21-d26906fed95a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Created volume successfully.
Jun 26 05:55:24 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-91b531cf-0060-4910-86d2-d29f41a9bf47 tempest-SnapshotDependencyTests-700556476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1e49a87a-6616-43be-8360-e43666e2fafd" returned: 0 in 1.089s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-91b531cf-0060-4910-86d2-d29f41a9bf47 tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1e49a87a-6616-43be-8360-e43666e2fafd {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:24 devstack sudo[108335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1e49a87a-6616-43be-8360-e43666e2fafd
Jun 26 05:55:24 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:25 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-783fa02e-05e8-4081-ab72-1d49f98b9c9d 1073741824" returned: 0 in 1.089s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-783fa02e-05e8-4081-ab72-1d49f98b9c9d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:25 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-91b531cf-0060-4910-86d2-d29f41a9bf47 tempest-SnapshotDependencyTests-700556476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1e49a87a-6616-43be-8360-e43666e2fafd" returned: 0 in 0.741s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:25 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-91b531cf-0060-4910-86d2-d29f41a9bf47 tempest-SnapshotDependencyTests-700556476 None] Lock "cinder-quobyte-1e49a87a-6616-43be-8360-e43666e2fafd" released by "delete_volume" :: held 1.899s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:25 devstack sudo[108342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-783fa02e-05e8-4081-ab72-1d49f98b9c9d
Jun 26 05:55:25 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:25 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-91b531cf-0060-4910-86d2-d29f41a9bf47 tempest-SnapshotDependencyTests-700556476 None] Created reservations ['0e433c38-eada-4252-b97e-eb47a907c0b5', 'c5aeb582-d162-4056-9753-05bb584a819f', '2ad47c0b-40bb-4764-a504-f3dfd90e4bc5', '5da2d0ff-75ff-4734-bf1f-c8fc41082230'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:55:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-91b531cf-0060-4910-86d2-d29f41a9bf47 tempest-SnapshotDependencyTests-700556476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-91b531cf-0060-4910-86d2-d29f41a9bf47 tempest-SnapshotDependencyTests-700556476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:25 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-91b531cf-0060-4910-86d2-d29f41a9bf47 tempest-SnapshotDependencyTests-700556476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:55:25 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-91b531cf-0060-4910-86d2-d29f41a9bf47 tempest-SnapshotDependencyTests-700556476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:55:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-91b531cf-0060-4910-86d2-d29f41a9bf47 tempest-SnapshotDependencyTests-700556476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-91b531cf-0060-4910-86d2-d29f41a9bf47 tempest-SnapshotDependencyTests-700556476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:25 devstack sudo[108344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:55:25 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:26 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-783fa02e-05e8-4081-ab72-1d49f98b9c9d" returned: 0 in 0.786s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:55:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.742s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1583873751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3edbe87-c22e-4732-8735-a341874dd3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc0732020804d58aba1a968f078e995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:55:21Z,use_quota=True,user_id='8f9fa90e42294fd8bd5a7abfd52defee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:55:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Creating volume a3edbe87-c22e-4732-8735-a341874dd3e3 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:55:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:55:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:55:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:55:26 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:55:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a3edbe87-c22e-4732-8735-a341874dd3e3 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9570c38-c660-442e-b86b-2b4c39d8d7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-783fa02e-05e8-4081-ab72-1d49f98b9c9d', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d11599-ef3a-49ae-84da-c0adf90d70d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:26 devstack sudo[108350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a3edbe87-c22e-4732-8735-a341874dd3e3 1073741824
Jun 26 05:55:26 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:26 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Volume volume-783fa02e-05e8-4081-ab72-1d49f98b9c9d (783fa02e-05e8-4081-ab72-1d49f98b9c9d): created successfully
Jun 26 05:55:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d11599-ef3a-49ae-84da-c0adf90d70d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Flow 'volume_create_manager' (c57cdf68-e91a-4b98-821d-1ac8de01b1ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:55:26 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e03dc3fc-fbba-443f-93c2-20b4e05050c1 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Created volume successfully.
Jun 26 05:55:26 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-91b531cf-0060-4910-86d2-d29f41a9bf47 tempest-SnapshotDependencyTests-700556476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.891s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:26 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-91b531cf-0060-4910-86d2-d29f41a9bf47 tempest-SnapshotDependencyTests-700556476 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:55:26 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-91b531cf-0060-4910-86d2-d29f41a9bf47 tempest-SnapshotDependencyTests-700556476 None] Deleted volume successfully.
Jun 26 05:55:26 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-91b531cf-0060-4910-86d2-d29f41a9bf47 tempest-SnapshotDependencyTests-700556476 None] Lock "cinder-1e49a87a-6616-43be-8360-e43666e2fafd-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:27 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a3edbe87-c22e-4732-8735-a341874dd3e3 1073741824" returned: 0 in 1.049s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a3edbe87-c22e-4732-8735-a341874dd3e3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:27 devstack sudo[108357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a3edbe87-c22e-4732-8735-a341874dd3e3
Jun 26 05:55:27 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:27 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a3edbe87-c22e-4732-8735-a341874dd3e3" returned: 0 in 0.725s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:55:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.188s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-38470683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0adee59a-5b5b-4f66-8475-0f9dfd90635c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc0732020804d58aba1a968f078e995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:55:22Z,use_quota=True,user_id='8f9fa90e42294fd8bd5a7abfd52defee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:55:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Creating volume 0adee59a-5b5b-4f66-8475-0f9dfd90635c {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:55:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:55:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:55:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:55:27 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:55:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0adee59a-5b5b-4f66-8475-0f9dfd90635c 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:27 devstack sudo[108361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0adee59a-5b5b-4f66-8475-0f9dfd90635c 1073741824
Jun 26 05:55:27 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c667f1b3-3efe-40b8-8715-f0eeae131c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3edbe87-c22e-4732-8735-a341874dd3e3', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d1304b-021c-4a29-babb-e845c59f4eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:28 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Volume volume-a3edbe87-c22e-4732-8735-a341874dd3e3 (a3edbe87-c22e-4732-8735-a341874dd3e3): created successfully
Jun 26 05:55:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d1304b-021c-4a29-babb-e845c59f4eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Flow 'volume_create_manager' (b72783c0-1d42-4510-be6e-7d50bcb21550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:55:28 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-f3832d57-4666-47ca-a536-ab227eddf150 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Created volume successfully.
Jun 26 05:55:29 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0adee59a-5b5b-4f66-8475-0f9dfd90635c 1073741824" returned: 0 in 1.130s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0adee59a-5b5b-4f66-8475-0f9dfd90635c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:29 devstack sudo[108402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0adee59a-5b5b-4f66-8475-0f9dfd90635c
Jun 26 05:55:29 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:29 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0adee59a-5b5b-4f66-8475-0f9dfd90635c" returned: 0 in 0.874s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] <== create_volume: return (2063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:55:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e231a9-bf8f-4eaf-b02a-eda6070bd48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0adee59a-5b5b-4f66-8475-0f9dfd90635c', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04350f3c-4cfc-433f-ad89-61f5cc534a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:55:30 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Volume volume-0adee59a-5b5b-4f66-8475-0f9dfd90635c (0adee59a-5b5b-4f66-8475-0f9dfd90635c): created successfully
Jun 26 05:55:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04350f3c-4cfc-433f-ad89-61f5cc534a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:55:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Flow 'volume_create_manager' (90b6ffad-1aa5-4c5a-b933-0680b82a5f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:55:30 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-b06c4db0-80be-46bd-91c5-a71631a9f646 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Created volume successfully.
Jun 26 05:55:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-19cfdc99-f68c-4e8a-a88a-03c5e90972b6 tempest-VolumesActionsTest-1819492261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-19cfdc99-f68c-4e8a-a88a-03c5e90972b6 tempest-VolumesActionsTest-1819492261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:30 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e20f02-dc01-42c7-8dd9-f203f969d838]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:55:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-19cfdc99-f68c-4e8a-a88a-03c5e90972b6 tempest-VolumesActionsTest-1819492261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:30 devstack sudo[108406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a
Jun 26 05:55:30 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8987d339-68c3-4b45-bc67-114cbe848273 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "cinder-0adee59a-5b5b-4f66-8475-0f9dfd90635c-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8987d339-68c3-4b45-bc67-114cbe848273 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-0adee59a-5b5b-4f66-8475-0f9dfd90635c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8987d339-68c3-4b45-bc67-114cbe848273 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "cinder-quobyte-0adee59a-5b5b-4f66-8475-0f9dfd90635c" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8987d339-68c3-4b45-bc67-114cbe848273 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-quobyte-0adee59a-5b5b-4f66-8475-0f9dfd90635c" acquired by "delete_volume" :: waited 0.021s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:30 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfc5e8e-ae1e-4000-ba72-6a2f8403c9ec]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:55:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8987d339-68c3-4b45-bc67-114cbe848273 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0adee59a-5b5b-4f66-8475-0f9dfd90635c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:31 devstack sudo[108408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0adee59a-5b5b-4f66-8475-0f9dfd90635c
Jun 26 05:55:31 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:31 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-19cfdc99-f68c-4e8a-a88a-03c5e90972b6 tempest-VolumesActionsTest-1819492261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a" returned: 0 in 1.091s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:31 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ee097b-cb79-44c2-a165-d8014972876b]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:55:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-19cfdc99-f68c-4e8a-a88a-03c5e90972b6 tempest-VolumesActionsTest-1819492261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:31 devstack sudo[108413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a
Jun 26 05:55:31 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:32 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8987d339-68c3-4b45-bc67-114cbe848273 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0adee59a-5b5b-4f66-8475-0f9dfd90635c" returned: 0 in 1.154s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8987d339-68c3-4b45-bc67-114cbe848273 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0adee59a-5b5b-4f66-8475-0f9dfd90635c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:32 devstack sudo[108420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0adee59a-5b5b-4f66-8475-0f9dfd90635c
Jun 26 05:55:32 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:32 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-19cfdc99-f68c-4e8a-a88a-03c5e90972b6 tempest-VolumesActionsTest-1819492261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a" returned: 0 in 1.105s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-19cfdc99-f68c-4e8a-a88a-03c5e90972b6 tempest-VolumesActionsTest-1819492261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a /opt/stack/data/cinder/conversion/16ff5b3a-b2c3-4923-9c21-cea47ee5f17a.temp_image.d13f6d35-fc0d-4abc-8403-611dee7e2b1d1rw4c88b.img {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:32 devstack sudo[108429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a /opt/stack/data/cinder/conversion/16ff5b3a-b2c3-4923-9c21-cea47ee5f17a.temp_image.d13f6d35-fc0d-4abc-8403-611dee7e2b1d1rw4c88b.img
Jun 26 05:55:32 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:33 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8987d339-68c3-4b45-bc67-114cbe848273 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0adee59a-5b5b-4f66-8475-0f9dfd90635c" returned: 0 in 1.041s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:33 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8987d339-68c3-4b45-bc67-114cbe848273 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-quobyte-0adee59a-5b5b-4f66-8475-0f9dfd90635c" released by "delete_volume" :: held 2.268s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:33 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-8987d339-68c3-4b45-bc67-114cbe848273 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Created reservations ['b7320869-0c65-4361-bcd2-71c575eaac73', 'd015456b-ad23-46c5-955b-498de35e1c3f', 'f5ca5aa1-55e0-49df-b7d9-077db7e78c75', 'df0a2ec2-a7b4-4215-8c25-86fa2e04c04a'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:55:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8987d339-68c3-4b45-bc67-114cbe848273 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8987d339-68c3-4b45-bc67-114cbe848273 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8987d339-68c3-4b45-bc67-114cbe848273 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:55:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8987d339-68c3-4b45-bc67-114cbe848273 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:55:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8987d339-68c3-4b45-bc67-114cbe848273 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8987d339-68c3-4b45-bc67-114cbe848273 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:33 devstack sudo[108446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:55:33 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-af848c5f-c532-4016-a1f4-0c68159ce726 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "cinder-a3edbe87-c22e-4732-8735-a341874dd3e3-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-af848c5f-c532-4016-a1f4-0c68159ce726 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-a3edbe87-c22e-4732-8735-a341874dd3e3-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-af848c5f-c532-4016-a1f4-0c68159ce726 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "cinder-quobyte-a3edbe87-c22e-4732-8735-a341874dd3e3" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-af848c5f-c532-4016-a1f4-0c68159ce726 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-quobyte-a3edbe87-c22e-4732-8735-a341874dd3e3" acquired by "delete_volume" :: waited 0.027s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:34 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afeb5ba-4a3f-4c30-ab53-52b95b715ecd]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:55:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-af848c5f-c532-4016-a1f4-0c68159ce726 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a3edbe87-c22e-4732-8735-a341874dd3e3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:34 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8987d339-68c3-4b45-bc67-114cbe848273 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.450s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:34 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-8987d339-68c3-4b45-bc67-114cbe848273 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:55:34 devstack sudo[108459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a3edbe87-c22e-4732-8735-a341874dd3e3
Jun 26 05:55:34 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:34 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-8987d339-68c3-4b45-bc67-114cbe848273 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Deleted volume successfully.
Jun 26 05:55:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8987d339-68c3-4b45-bc67-114cbe848273 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-0adee59a-5b5b-4f66-8475-0f9dfd90635c-delete_volume" released by "delete_volume" :: held 4.127s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:36 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-af848c5f-c532-4016-a1f4-0c68159ce726 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a3edbe87-c22e-4732-8735-a341874dd3e3" returned: 0 in 2.296s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-af848c5f-c532-4016-a1f4-0c68159ce726 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a3edbe87-c22e-4732-8735-a341874dd3e3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:36 devstack sudo[108466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a3edbe87-c22e-4732-8735-a341874dd3e3
Jun 26 05:55:36 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:38 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-af848c5f-c532-4016-a1f4-0c68159ce726 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a3edbe87-c22e-4732-8735-a341874dd3e3" returned: 0 in 1.361s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-af848c5f-c532-4016-a1f4-0c68159ce726 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-quobyte-a3edbe87-c22e-4732-8735-a341874dd3e3" released by "delete_volume" :: held 3.793s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:38 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-af848c5f-c532-4016-a1f4-0c68159ce726 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Created reservations ['4d42d97f-0bfd-44b4-b4da-0f39e404866d', 'eadd45b2-b075-4efa-8f21-23dcce9b8c52', '21633bef-9a49-4f7f-b6cf-9d3c10639b9e', '96535f04-cd18-43f0-8c99-53568481c6ef'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:55:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-af848c5f-c532-4016-a1f4-0c68159ce726 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-af848c5f-c532-4016-a1f4-0c68159ce726 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:38 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-af848c5f-c532-4016-a1f4-0c68159ce726 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:55:38 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-af848c5f-c532-4016-a1f4-0c68159ce726 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:55:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-af848c5f-c532-4016-a1f4-0c68159ce726 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-af848c5f-c532-4016-a1f4-0c68159ce726 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:38 devstack sudo[108473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:55:38 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5ca1e6e8-03e0-491c-8245-945649cc25e7 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "cinder-783fa02e-05e8-4081-ab72-1d49f98b9c9d-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5ca1e6e8-03e0-491c-8245-945649cc25e7 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-783fa02e-05e8-4081-ab72-1d49f98b9c9d-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5ca1e6e8-03e0-491c-8245-945649cc25e7 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "cinder-quobyte-783fa02e-05e8-4081-ab72-1d49f98b9c9d" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5ca1e6e8-03e0-491c-8245-945649cc25e7 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-quobyte-783fa02e-05e8-4081-ab72-1d49f98b9c9d" acquired by "delete_volume" :: waited 0.041s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:39 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fd62ae-0c03-401d-839c-143693e3ea92]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:55:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5ca1e6e8-03e0-491c-8245-945649cc25e7 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-783fa02e-05e8-4081-ab72-1d49f98b9c9d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:39 devstack sudo[108475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-783fa02e-05e8-4081-ab72-1d49f98b9c9d
Jun 26 05:55:39 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:39 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-19cfdc99-f68c-4e8a-a88a-03c5e90972b6 tempest-VolumesActionsTest-1819492261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a /opt/stack/data/cinder/conversion/16ff5b3a-b2c3-4923-9c21-cea47ee5f17a.temp_image.d13f6d35-fc0d-4abc-8403-611dee7e2b1d1rw4c88b.img" returned: 0 in 7.031s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:39 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c15c8e1-b0f9-43ee-bf01-c3cb70a7ae39]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:55:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-19cfdc99-f68c-4e8a-a88a-03c5e90972b6 tempest-VolumesActionsTest-1819492261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:39 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-af848c5f-c532-4016-a1f4-0c68159ce726 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.149s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:39 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-af848c5f-c532-4016-a1f4-0c68159ce726 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:55:39 devstack sudo[108478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a
Jun 26 05:55:39 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:39 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-af848c5f-c532-4016-a1f4-0c68159ce726 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Deleted volume successfully.
Jun 26 05:55:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-af848c5f-c532-4016-a1f4-0c68159ce726 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-a3edbe87-c22e-4732-8735-a341874dd3e3-delete_volume" released by "delete_volume" :: held 5.466s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:40 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5ca1e6e8-03e0-491c-8245-945649cc25e7 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-783fa02e-05e8-4081-ab72-1d49f98b9c9d" returned: 0 in 0.974s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5ca1e6e8-03e0-491c-8245-945649cc25e7 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-783fa02e-05e8-4081-ab72-1d49f98b9c9d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:40 devstack sudo[108500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-783fa02e-05e8-4081-ab72-1d49f98b9c9d
Jun 26 05:55:40 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:41 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-19cfdc99-f68c-4e8a-a88a-03c5e90972b6 tempest-VolumesActionsTest-1819492261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a" returned: 0 in 1.499s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:41 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-19cfdc99-f68c-4e8a-a88a-03c5e90972b6 tempest-VolumesActionsTest-1819492261 None] Image conversion details: src /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a, size 1024.00 MB, duration 7.03 sec, destination /opt/stack/data/cinder/conversion/16ff5b3a-b2c3-4923-9c21-cea47ee5f17a.temp_image.d13f6d35-fc0d-4abc-8403-611dee7e2b1d1rw4c88b.img {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 05:55:41 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-19cfdc99-f68c-4e8a-a88a-03c5e90972b6 tempest-VolumesActionsTest-1819492261 None] Converted 1024.00 MB image at 145.62 MB/s
Jun 26 05:55:41 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-19cfdc99-f68c-4e8a-a88a-03c5e90972b6 tempest-VolumesActionsTest-1819492261 None] d13f6d35-fc0d-4abc-8403-611dee7e2b1d was raw, no need to convert to raw {{(pid=93708) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jun 26 05:55:41 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5ca1e6e8-03e0-491c-8245-945649cc25e7 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-783fa02e-05e8-4081-ab72-1d49f98b9c9d" returned: 0 in 1.274s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5ca1e6e8-03e0-491c-8245-945649cc25e7 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-quobyte-783fa02e-05e8-4081-ab72-1d49f98b9c9d" released by "delete_volume" :: held 2.348s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:41 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-5ca1e6e8-03e0-491c-8245-945649cc25e7 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Created reservations ['dbc05131-8d0d-491d-810d-8cdd9881d0a0', '8a9780a8-e7d7-4edd-8b66-a2925c03383e', '2044d94d-0731-42f1-a75b-532153cfff3e', '7f40c6ce-b92d-4fa3-9803-8845c6f81e97'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:55:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-5ca1e6e8-03e0-491c-8245-945649cc25e7 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-5ca1e6e8-03e0-491c-8245-945649cc25e7 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-5ca1e6e8-03e0-491c-8245-945649cc25e7 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:55:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-5ca1e6e8-03e0-491c-8245-945649cc25e7 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:55:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-5ca1e6e8-03e0-491c-8245-945649cc25e7 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5ca1e6e8-03e0-491c-8245-945649cc25e7 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:41 devstack sudo[108572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:55:41 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:42 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5ca1e6e8-03e0-491c-8245-945649cc25e7 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.696s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:42 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-5ca1e6e8-03e0-491c-8245-945649cc25e7 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:55:42 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-5ca1e6e8-03e0-491c-8245-945649cc25e7 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Deleted volume successfully.
Jun 26 05:55:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5ca1e6e8-03e0-491c-8245-945649cc25e7 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-783fa02e-05e8-4081-ab72-1d49f98b9c9d-delete_volume" released by "delete_volume" :: held 3.422s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2f3ddb58-976c-4c59-b966-dc1a87f3bd0a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "cinder-1cae848c-e6da-4051-967e-f2d8e6e500b9-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2f3ddb58-976c-4c59-b966-dc1a87f3bd0a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-1cae848c-e6da-4051-967e-f2d8e6e500b9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2f3ddb58-976c-4c59-b966-dc1a87f3bd0a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "cinder-quobyte-1cae848c-e6da-4051-967e-f2d8e6e500b9" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2f3ddb58-976c-4c59-b966-dc1a87f3bd0a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-quobyte-1cae848c-e6da-4051-967e-f2d8e6e500b9" acquired by "delete_volume" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:42 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[76195be9-b4f8-4212-80eb-1d184e9cc2dc]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:55:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f3ddb58-976c-4c59-b966-dc1a87f3bd0a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1cae848c-e6da-4051-967e-f2d8e6e500b9 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:43 devstack sudo[108578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1cae848c-e6da-4051-967e-f2d8e6e500b9
Jun 26 05:55:43 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:44 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f3ddb58-976c-4c59-b966-dc1a87f3bd0a tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1cae848c-e6da-4051-967e-f2d8e6e500b9" returned: 0 in 1.210s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f3ddb58-976c-4c59-b966-dc1a87f3bd0a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1cae848c-e6da-4051-967e-f2d8e6e500b9 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:44 devstack sudo[108583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1cae848c-e6da-4051-967e-f2d8e6e500b9
Jun 26 05:55:44 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:45 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f3ddb58-976c-4c59-b966-dc1a87f3bd0a tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1cae848c-e6da-4051-967e-f2d8e6e500b9" returned: 0 in 0.971s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:45 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2f3ddb58-976c-4c59-b966-dc1a87f3bd0a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-quobyte-1cae848c-e6da-4051-967e-f2d8e6e500b9" released by "delete_volume" :: held 2.250s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:45 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-2f3ddb58-976c-4c59-b966-dc1a87f3bd0a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Created reservations ['24a40112-180c-405e-84d2-4266d886ecc7', '6cd36707-e24e-4145-abb6-522f1623af0e', '82901c1e-b68f-4035-b41c-a8b10f706388', '671ff81b-b683-4292-98c6-86434a943f75'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:55:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2f3ddb58-976c-4c59-b966-dc1a87f3bd0a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2f3ddb58-976c-4c59-b966-dc1a87f3bd0a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2f3ddb58-976c-4c59-b966-dc1a87f3bd0a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:55:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-2f3ddb58-976c-4c59-b966-dc1a87f3bd0a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:55:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2f3ddb58-976c-4c59-b966-dc1a87f3bd0a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f3ddb58-976c-4c59-b966-dc1a87f3bd0a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:45 devstack sudo[108586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:55:45 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:46 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-22d91285-94ca-45aa-b6d9-97d34d4085df tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "cinder-e142072b-13eb-4f10-86dc-d9d3c310c192-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:46 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-22d91285-94ca-45aa-b6d9-97d34d4085df tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-e142072b-13eb-4f10-86dc-d9d3c310c192-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:46 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-22d91285-94ca-45aa-b6d9-97d34d4085df tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "cinder-quobyte-e142072b-13eb-4f10-86dc-d9d3c310c192" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:46 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-22d91285-94ca-45aa-b6d9-97d34d4085df tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-quobyte-e142072b-13eb-4f10-86dc-d9d3c310c192" acquired by "delete_volume" :: waited 0.034s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:46 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d6c88c-9217-4386-ba91-da434d28bfb1]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:55:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-22d91285-94ca-45aa-b6d9-97d34d4085df tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e142072b-13eb-4f10-86dc-d9d3c310c192 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:46 devstack sudo[108589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e142072b-13eb-4f10-86dc-d9d3c310c192
Jun 26 05:55:46 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:46 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f3ddb58-976c-4c59-b966-dc1a87f3bd0a tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.478s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:46 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-2f3ddb58-976c-4c59-b966-dc1a87f3bd0a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:55:46 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-2f3ddb58-976c-4c59-b966-dc1a87f3bd0a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Deleted volume successfully.
Jun 26 05:55:46 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-2f3ddb58-976c-4c59-b966-dc1a87f3bd0a tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-1cae848c-e6da-4051-967e-f2d8e6e500b9-delete_volume" released by "delete_volume" :: held 4.187s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:47 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-22d91285-94ca-45aa-b6d9-97d34d4085df tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e142072b-13eb-4f10-86dc-d9d3c310c192" returned: 0 in 1.242s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-22d91285-94ca-45aa-b6d9-97d34d4085df tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e142072b-13eb-4f10-86dc-d9d3c310c192 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:47 devstack sudo[108596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e142072b-13eb-4f10-86dc-d9d3c310c192
Jun 26 05:55:47 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:48 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-22d91285-94ca-45aa-b6d9-97d34d4085df tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e142072b-13eb-4f10-86dc-d9d3c310c192" returned: 0 in 1.081s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:48 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-22d91285-94ca-45aa-b6d9-97d34d4085df tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-quobyte-e142072b-13eb-4f10-86dc-d9d3c310c192" released by "delete_volume" :: held 2.392s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:48 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=88,cinder:UPDATE=82,cinder:INSERT=23,cinder:DELETE=5 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:55:48 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=81,cinder:UPDATE=100,cinder:INSERT=19,cinder:DELETE=12 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:55:48 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-22d91285-94ca-45aa-b6d9-97d34d4085df tempest-CreateVolumesFromSnapshotTest-1222607117 None] Created reservations ['8d303ace-12a6-4085-b0e3-243001e3fd0b', 'eb5a3c0d-6f13-463e-883b-7caab9b7ea32', '93e82615-4ced-4193-8ce2-d8b3204a7e56', '2114cc9a-4c6e-4696-ae85-e1a5d69d3516'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:55:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-22d91285-94ca-45aa-b6d9-97d34d4085df tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-22d91285-94ca-45aa-b6d9-97d34d4085df tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:48 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-22d91285-94ca-45aa-b6d9-97d34d4085df tempest-CreateVolumesFromSnapshotTest-1222607117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:55:48 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-22d91285-94ca-45aa-b6d9-97d34d4085df tempest-CreateVolumesFromSnapshotTest-1222607117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:55:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-22d91285-94ca-45aa-b6d9-97d34d4085df tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-22d91285-94ca-45aa-b6d9-97d34d4085df tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:49 devstack sudo[108599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:55:49 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "cinder-a028f2b8-c58f-4ced-a9f8-1ae8935602e4-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-a028f2b8-c58f-4ced-a9f8-1ae8935602e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "cinder-quobyte-235cbf00-fe59-4628-83d6-b6f7f7c5a588" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-quobyte-235cbf00-fe59-4628-83d6-b6f7f7c5a588" acquired by "delete_snapshot" :: waited 0.042s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "cinder-quobyte-a028f2b8-c58f-4ced-a9f8-1ae8935602e4" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-quobyte-a028f2b8-c58f-4ced-a9f8-1ae8935602e4" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:49 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Deleting offline snapshot a028f2b8-c58f-4ced-a9f8-1ae8935602e4 of volume 235cbf00-fe59-4628-83d6-b6f7f7c5a588 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:55:49 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] snapshot_file for this snap is: volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.a028f2b8-c58f-4ced-a9f8-1ae8935602e4 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:55:49 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[85eb5f36-8a09-4a54-8107-5c1bb896cdce]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:55:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.a028f2b8-c58f-4ced-a9f8-1ae8935602e4 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:49 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-22d91285-94ca-45aa-b6d9-97d34d4085df tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.952s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:49 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-22d91285-94ca-45aa-b6d9-97d34d4085df tempest-CreateVolumesFromSnapshotTest-1222607117 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:55:49 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-22d91285-94ca-45aa-b6d9-97d34d4085df tempest-CreateVolumesFromSnapshotTest-1222607117 None] Deleted volume successfully.
Jun 26 05:55:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-22d91285-94ca-45aa-b6d9-97d34d4085df tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-e142072b-13eb-4f10-86dc-d9d3c310c192-delete_volume" released by "delete_volume" :: held 3.659s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:50 devstack sudo[108603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.a028f2b8-c58f-4ced-a9f8-1ae8935602e4
Jun 26 05:55:50 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:50 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.a028f2b8-c58f-4ced-a9f8-1ae8935602e4" returned: 0 in 0.900s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:50 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:55:50 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdcf342-bc7a-4a3e-bf67-43e04a306d70]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:55:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:50 devstack sudo[108608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588
Jun 26 05:55:50 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:51 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588" returned: 0 in 0.823s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.a028f2b8-c58f-4ced-a9f8-1ae8935602e4 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:51 devstack sudo[108614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.a028f2b8-c58f-4ced-a9f8-1ae8935602e4
Jun 26 05:55:51 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:52 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.a028f2b8-c58f-4ced-a9f8-1ae8935602e4" returned: 0 in 0.825s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.a028f2b8-c58f-4ced-a9f8-1ae8935602e4 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:52 devstack sudo[108620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.a028f2b8-c58f-4ced-a9f8-1ae8935602e4
Jun 26 05:55:52 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:53 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588.a028f2b8-c58f-4ced-a9f8-1ae8935602e4" returned: 0 in 0.847s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:53 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-quobyte-a028f2b8-c58f-4ced-a9f8-1ae8935602e4" released by "_delete_snapshot" :: held 3.551s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:53 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-quobyte-235cbf00-fe59-4628-83d6-b6f7f7c5a588" released by "delete_snapshot" :: held 3.590s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:53 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Created reservations ['354ee0b6-bc9a-43ca-a7e6-3dee22273f66', '17a57693-3a23-483b-8911-703248dcb0ed', '05d27a1d-4504-4bbd-ae02-8f3b2aad37f6', '77496a81-828a-413e-b16e-ce651d4beed9'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:55:53 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Delete snapshot completed successfully.
Jun 26 05:55:53 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-229ba3f4-733a-4afa-9730-e2332a37fb41 tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-a028f2b8-c58f-4ced-a9f8-1ae8935602e4-delete_snapshot" released by "delete_snapshot" :: held 3.826s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:54 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-df194a12-fcc4-4d33-a49a-94131e5c92de tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "cinder-235cbf00-fe59-4628-83d6-b6f7f7c5a588-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:54 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-df194a12-fcc4-4d33-a49a-94131e5c92de tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-235cbf00-fe59-4628-83d6-b6f7f7c5a588-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:54 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-df194a12-fcc4-4d33-a49a-94131e5c92de tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "cinder-quobyte-235cbf00-fe59-4628-83d6-b6f7f7c5a588" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:55:54 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-df194a12-fcc4-4d33-a49a-94131e5c92de tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-quobyte-235cbf00-fe59-4628-83d6-b6f7f7c5a588" acquired by "delete_volume" :: waited 0.021s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:55:54 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c16ba4-4ad4-4fb1-bc8a-976d0283681e]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:55:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-df194a12-fcc4-4d33-a49a-94131e5c92de tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:54 devstack sudo[108657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588
Jun 26 05:55:54 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:55 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-df194a12-fcc4-4d33-a49a-94131e5c92de tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588" returned: 0 in 0.807s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-df194a12-fcc4-4d33-a49a-94131e5c92de tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:55 devstack sudo[108662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588
Jun 26 05:55:55 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:56 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-df194a12-fcc4-4d33-a49a-94131e5c92de tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-235cbf00-fe59-4628-83d6-b6f7f7c5a588" returned: 0 in 0.641s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:56 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-df194a12-fcc4-4d33-a49a-94131e5c92de tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-quobyte-235cbf00-fe59-4628-83d6-b6f7f7c5a588" released by "delete_volume" :: held 1.533s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:55:56 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-df194a12-fcc4-4d33-a49a-94131e5c92de tempest-CreateVolumesFromSnapshotTest-1222607117 None] Created reservations ['cd242597-a17a-4de2-b505-d1c726e5eb30', '6455cb95-3852-4aed-8ccc-ff9282edb7d6', 'bd969fce-66a8-4084-89e2-2c3c7af8e76c', 'e7f3d035-a3d8-4beb-99a9-9d9cecd37bd1'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:55:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-df194a12-fcc4-4d33-a49a-94131e5c92de tempest-CreateVolumesFromSnapshotTest-1222607117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:55:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-df194a12-fcc4-4d33-a49a-94131e5c92de tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:55:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-df194a12-fcc4-4d33-a49a-94131e5c92de tempest-CreateVolumesFromSnapshotTest-1222607117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:55:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-df194a12-fcc4-4d33-a49a-94131e5c92de tempest-CreateVolumesFromSnapshotTest-1222607117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:55:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-df194a12-fcc4-4d33-a49a-94131e5c92de tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:55:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-df194a12-fcc4-4d33-a49a-94131e5c92de tempest-CreateVolumesFromSnapshotTest-1222607117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:55:56 devstack sudo[108665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:55:56 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:55:57 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root
Jun 26 05:55:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-df194a12-fcc4-4d33-a49a-94131e5c92de tempest-CreateVolumesFromSnapshotTest-1222607117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.708s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:55:57 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-df194a12-fcc4-4d33-a49a-94131e5c92de tempest-CreateVolumesFromSnapshotTest-1222607117 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:55:57 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-df194a12-fcc4-4d33-a49a-94131e5c92de tempest-CreateVolumesFromSnapshotTest-1222607117 None] Deleted volume successfully.
Jun 26 05:55:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-df194a12-fcc4-4d33-a49a-94131e5c92de tempest-CreateVolumesFromSnapshotTest-1222607117 None] Lock "cinder-235cbf00-fe59-4628-83d6-b6f7f7c5a588-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:56:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-19cfdc99-f68c-4e8a-a88a-03c5e90972b6 tempest-VolumesActionsTest-1819492261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.633s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:56:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-19cfdc99-f68c-4e8a-a88a-03c5e90972b6 tempest-VolumesActionsTest-1819492261 None] Uploaded volume to glance image-id: d13f6d35-fc0d-4abc-8403-611dee7e2b1d. {{(pid=93708) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jun 26 05:56:03 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-19cfdc99-f68c-4e8a-a88a-03c5e90972b6 tempest-VolumesActionsTest-1819492261 None] Copy volume to image completed successfully.
Jun 26 05:56:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:56:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:56:04 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a0965d-7f3b-4e49-ac14-e540da2d701e]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:05 devstack sudo[108690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a
Jun 26 05:56:05 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:05 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a" returned: 0 in 0.785s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:05 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d4346d-e1e3-4b3b-8772-36c3f15bffd2]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:05 devstack sudo[108695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a
Jun 26 05:56:05 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:06 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a" returned: 0 in 0.746s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a /opt/stack/data/cinder/conversion/16ff5b3a-b2c3-4923-9c21-cea47ee5f17a.temp_image.5b7efd16-e1ad-4dd0-8467-dd609d165ee9y6v6d45g.img {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:06 devstack sudo[108700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a /opt/stack/data/cinder/conversion/16ff5b3a-b2c3-4923-9c21-cea47ee5f17a.temp_image.5b7efd16-e1ad-4dd0-8467-dd609d165ee9y6v6d45g.img
Jun 26 05:56:06 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:07 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:56:07 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Flow 'volume_create_manager' (689b8868-47e6-40c0-9d37-c05fa0405b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:56:07 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a12411e-1988-462e-9ce3-f2b035720621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:07 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a12411e-1988-462e-9ce3-f2b035720621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-584816463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd64d72-43e1-44b5-bfa7-87f141866583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84bed9b8b4ed475984b0aa2c9427d7ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:56:07Z,use_quota=True,user_id='e43a1f55a87541d885f132698206f785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:07 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff59b42-7abe-497a-864f-43eea52a63bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:07 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff59b42-7abe-497a-864f-43eea52a63bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:07 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a8f8d4-73ac-4e7d-b7c7-c8b3261a1dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:07 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a8f8d4-73ac-4e7d-b7c7-c8b3261a1dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bd64d72-43e1-44b5-bfa7-87f141866583', 'volume_name': 'volume-5bd64d72-43e1-44b5-bfa7-87f141866583', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:07 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee5d3c1-78ee-43d2-8f36-6f0a04d8be05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:07 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee5d3c1-78ee-43d2-8f36-6f0a04d8be05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:07 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0dbd88-3edd-45ef-87ef-85066d9bb504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:07 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Volume 5bd64d72-43e1-44b5-bfa7-87f141866583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bd64d72-43e1-44b5-bfa7-87f141866583', 'volume_size': 1}
Jun 26 05:56:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:56:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:56:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:56:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:56:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:56:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:56:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:56:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:10 devstack sudo[108715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:56:10 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:11 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a /opt/stack/data/cinder/conversion/16ff5b3a-b2c3-4923-9c21-cea47ee5f17a.temp_image.5b7efd16-e1ad-4dd0-8467-dd609d165ee9y6v6d45g.img" returned: 0 in 4.744s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:11 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad9315c-ece1-467c-ae55-292ba54c7343]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:11 devstack sudo[108717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a
Jun 26 05:56:11 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:11 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.883s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:11 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:56:11 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:56:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 28 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:56:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>, <Thread(tpool_thread_0, started daemon 124035494721216)>, <Thread(tpool_thread_1, started daemon 124035486328512)>, <Thread(tpool_thread_2, started daemon 124035477919424)>, <Thread(tpool_thread_3, started daemon 124035469510336)>, <Thread(tpool_thread_4, started daemon 124035461101248)>, <Thread(tpool_thread_5, started daemon 124035452692160)>, <Thread(tpool_thread_6, started daemon 124035444283072)>, <Thread(tpool_thread_7, started daemon 124035435873984)>, <Thread(tpool_thread_8, started daemon 124035427464896)>, <Thread(tpool_thread_9, started daemon 124035419055808)>, <Thread(tpool_thread_10, started daemon 124035410646720)>, <Thread(tpool_thread_11, started daemon 124035402237632)>, <Thread(tpool_thread_12, started daemon 124035393828544)>, <Thread(tpool_thread_13, started daemon 124035385419456)>, <Thread(tpool_thread_14, started daemon 124035377010368)>, <Thread(tpool_thread_15, started daemon 124035368601280)>, <Thread(tpool_thread_16, started daemon 124035360192192)>, <Thread(tpool_thread_17, started daemon 124035351783104)>, <Thread(tpool_thread_18, started daemon 124035343374016)>, <Thread(tpool_thread_19, started daemon 124035334964928)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:56:12 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a" returned: 0 in 0.935s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:12 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] Image conversion details: src /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a, size 1024.00 MB, duration 4.75 sec, destination /opt/stack/data/cinder/conversion/16ff5b3a-b2c3-4923-9c21-cea47ee5f17a.temp_image.5b7efd16-e1ad-4dd0-8467-dd609d165ee9y6v6d45g.img {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 05:56:12 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] Converted 1024.00 MB image at 215.77 MB/s
Jun 26 05:56:12 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] 5b7efd16-e1ad-4dd0-8467-dd609d165ee9 was raw, converting to qcow2 {{(pid=93708) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jun 26 05:56:12 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[954d4a6c-8f59-44f6-9e96-397e99c88adc]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/16ff5b3a-b2c3-4923-9c21-cea47ee5f17a.temp_image.5b7efd16-e1ad-4dd0-8467-dd609d165ee9y6v6d45g.img {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:12 devstack sudo[108724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/16ff5b3a-b2c3-4923-9c21-cea47ee5f17a.temp_image.5b7efd16-e1ad-4dd0-8467-dd609d165ee9y6v6d45g.img
Jun 26 05:56:12 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:12 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/16ff5b3a-b2c3-4923-9c21-cea47ee5f17a.temp_image.5b7efd16-e1ad-4dd0-8467-dd609d165ee9y6v6d45g.img" returned: 0 in 0.735s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/16ff5b3a-b2c3-4923-9c21-cea47ee5f17a.temp_image.5b7efd16-e1ad-4dd0-8467-dd609d165ee9y6v6d45g.img {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:13 devstack sudo[108728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/16ff5b3a-b2c3-4923-9c21-cea47ee5f17a.temp_image.5b7efd16-e1ad-4dd0-8467-dd609d165ee9y6v6d45g.img
Jun 26 05:56:13 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:13 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/16ff5b3a-b2c3-4923-9c21-cea47ee5f17a.temp_image.5b7efd16-e1ad-4dd0-8467-dd609d165ee9y6v6d45g.img" returned: 1 in 0.702s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/16ff5b3a-b2c3-4923-9c21-cea47ee5f17a.temp_image.5b7efd16-e1ad-4dd0-8467-dd609d165ee9y6v6d45g.img' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 05:56:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/16ff5b3a-b2c3-4923-9c21-cea47ee5f17a.temp_image.5b7efd16-e1ad-4dd0-8467-dd609d165ee9y6v6d45g.img /opt/stack/data/cinder/conversion/vol_upload__7gchup4 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:13 devstack sudo[108733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/16ff5b3a-b2c3-4923-9c21-cea47ee5f17a.temp_image.5b7efd16-e1ad-4dd0-8467-dd609d165ee9y6v6d45g.img /opt/stack/data/cinder/conversion/vol_upload__7gchup4
Jun 26 05:56:13 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:14 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/16ff5b3a-b2c3-4923-9c21-cea47ee5f17a.temp_image.5b7efd16-e1ad-4dd0-8467-dd609d165ee9y6v6d45g.img /opt/stack/data/cinder/conversion/vol_upload__7gchup4" returned: 0 in 0.653s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:14 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] Image conversion details: src /opt/stack/data/cinder/conversion/16ff5b3a-b2c3-4923-9c21-cea47ee5f17a.temp_image.5b7efd16-e1ad-4dd0-8467-dd609d165ee9y6v6d45g.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload__7gchup4 {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 05:56:14 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] Converted 1024.00 MB image at 1024.00 MB/s
Jun 26 05:56:14 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[df32752c-8aeb-436e-97ec-2983597f8ebc]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__7gchup4 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:14 devstack sudo[108738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__7gchup4
Jun 26 05:56:14 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:15 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__7gchup4" returned: 0 in 0.733s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.355s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:56:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] Uploaded volume to glance image-id: 5b7efd16-e1ad-4dd0-8467-dd609d165ee9. {{(pid=93708) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jun 26 05:56:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.587s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:56:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-584816463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd64d72-43e1-44b5-bfa7-87f141866583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84bed9b8b4ed475984b0aa2c9427d7ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:56:07Z,use_quota=True,user_id='e43a1f55a87541d885f132698206f785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:56:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Creating volume 5bd64d72-43e1-44b5-bfa7-87f141866583 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:56:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:56:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:56:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:56:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:56:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:56:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:56:16 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:56:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5bd64d72-43e1-44b5-bfa7-87f141866583 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:16 devstack sudo[108744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5bd64d72-43e1-44b5-bfa7-87f141866583 1073741824
Jun 26 05:56:16 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:16 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-739e9e6d-8e45-4a63-b020-e682e639fcea tempest-VolumesActionsTest-1819492261 None] Copy volume to image completed successfully.
Jun 26 05:56:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7833ca5a-18a0-4900-becf-01624c0a0902 tempest-VolumesActionsTest-1819492261 None] Acquiring lock "cinder-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:56:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7833ca5a-18a0-4900-becf-01624c0a0902 tempest-VolumesActionsTest-1819492261 None] Lock "cinder-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:56:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7833ca5a-18a0-4900-becf-01624c0a0902 tempest-VolumesActionsTest-1819492261 None] Acquiring lock "cinder-quobyte-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:56:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7833ca5a-18a0-4900-becf-01624c0a0902 tempest-VolumesActionsTest-1819492261 None] Lock "cinder-quobyte-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a" acquired by "delete_volume" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:56:17 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbeba2e7-412f-4edd-af6b-f8da6d141f91]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7833ca5a-18a0-4900-becf-01624c0a0902 tempest-VolumesActionsTest-1819492261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:17 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5bd64d72-43e1-44b5-bfa7-87f141866583 1073741824" returned: 0 in 0.916s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5bd64d72-43e1-44b5-bfa7-87f141866583 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:17 devstack sudo[108750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5bd64d72-43e1-44b5-bfa7-87f141866583
Jun 26 05:56:17 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:17 devstack sudo[108749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a
Jun 26 05:56:17 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:17 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5bd64d72-43e1-44b5-bfa7-87f141866583" returned: 0 in 0.658s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:17 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:56:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:56:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0dbd88-3edd-45ef-87ef-85066d9bb504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bd64d72-43e1-44b5-bfa7-87f141866583', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471cfaa4-aff3-4daa-b341-082fbac05ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:18 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Volume volume-5bd64d72-43e1-44b5-bfa7-87f141866583 (5bd64d72-43e1-44b5-bfa7-87f141866583): created successfully
Jun 26 05:56:18 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471cfaa4-aff3-4daa-b341-082fbac05ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Flow 'volume_create_manager' (689b8868-47e6-40c0-9d37-c05fa0405b75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:56:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7833ca5a-18a0-4900-becf-01624c0a0902 tempest-VolumesActionsTest-1819492261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a" returned: 0 in 0.778s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7833ca5a-18a0-4900-becf-01624c0a0902 tempest-VolumesActionsTest-1819492261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:18 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-7cb1b829-a2ec-483b-beb6-eebe23503194 tempest-AttachVolumeNegativeTest-1214912838 None] Created volume successfully.
Jun 26 05:56:18 devstack sudo[108757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a
Jun 26 05:56:18 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:18 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7833ca5a-18a0-4900-becf-01624c0a0902 tempest-VolumesActionsTest-1819492261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a" returned: 0 in 0.687s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:18 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7833ca5a-18a0-4900-becf-01624c0a0902 tempest-VolumesActionsTest-1819492261 None] Lock "cinder-quobyte-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a" released by "delete_volume" :: held 1.505s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:56:18 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-7833ca5a-18a0-4900-becf-01624c0a0902 tempest-VolumesActionsTest-1819492261 None] Created reservations ['7f4d20cd-2f0b-4bb0-9384-1eb5daee514e', '6d259921-e87c-477b-9c1b-ae07bafd1cc4', '15ff9dbf-3ea8-4ff5-bab7-5216e1cc88af', '777d270d-14b3-47f6-a85a-55a29e82f8f7'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:56:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7833ca5a-18a0-4900-becf-01624c0a0902 tempest-VolumesActionsTest-1819492261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:56:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7833ca5a-18a0-4900-becf-01624c0a0902 tempest-VolumesActionsTest-1819492261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:56:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7833ca5a-18a0-4900-becf-01624c0a0902 tempest-VolumesActionsTest-1819492261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:56:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7833ca5a-18a0-4900-becf-01624c0a0902 tempest-VolumesActionsTest-1819492261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:56:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7833ca5a-18a0-4900-becf-01624c0a0902 tempest-VolumesActionsTest-1819492261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:56:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7833ca5a-18a0-4900-becf-01624c0a0902 tempest-VolumesActionsTest-1819492261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:18 devstack sudo[108763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:56:18 devstack sudo[108763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:19 devstack sudo[108763]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7833ca5a-18a0-4900-becf-01624c0a0902 tempest-VolumesActionsTest-1819492261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.696s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:19 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-7833ca5a-18a0-4900-becf-01624c0a0902 tempest-VolumesActionsTest-1819492261 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:56:19 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-7833ca5a-18a0-4900-becf-01624c0a0902 tempest-VolumesActionsTest-1819492261 None] Deleted volume successfully.
Jun 26 05:56:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7833ca5a-18a0-4900-becf-01624c0a0902 tempest-VolumesActionsTest-1819492261 None] Lock "cinder-16ff5b3a-b2c3-4923-9c21-cea47ee5f17a-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:56:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-351ab7ed-96f1-4cbe-989f-ca3e2beb2b16 req-3811bf65-dfc6-4a91-87d6-d81912b41212 tempest-AttachVolumeNegativeTest-1214912838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:56:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-351ab7ed-96f1-4cbe-989f-ca3e2beb2b16 req-3811bf65-dfc6-4a91-87d6-d81912b41212 tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:56:21 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[301ffa16-8f58-4f7f-b4e3-81261ad34b2c]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-351ab7ed-96f1-4cbe-989f-ca3e2beb2b16 req-3811bf65-dfc6-4a91-87d6-d81912b41212 tempest-AttachVolumeNegativeTest-1214912838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5bd64d72-43e1-44b5-bfa7-87f141866583 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:21 devstack sudo[108775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5bd64d72-43e1-44b5-bfa7-87f141866583
Jun 26 05:56:21 devstack sudo[108775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:22 devstack sudo[108775]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-351ab7ed-96f1-4cbe-989f-ca3e2beb2b16 req-3811bf65-dfc6-4a91-87d6-d81912b41212 tempest-AttachVolumeNegativeTest-1214912838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5bd64d72-43e1-44b5-bfa7-87f141866583" returned: 0 in 0.840s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-351ab7ed-96f1-4cbe-989f-ca3e2beb2b16 req-3811bf65-dfc6-4a91-87d6-d81912b41212 tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.859s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:56:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-351ab7ed-96f1-4cbe-989f-ca3e2beb2b16 req-3811bf65-dfc6-4a91-87d6-d81912b41212 tempest-AttachVolumeNegativeTest-1214912838 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85', 'name': 'volume-5bd64d72-43e1-44b5-bfa7-87f141866583', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '136d5dc3-c512-4d89-99e6-5c5ab5aa72be', 'enforce_multipath': True} {{(pid=93708) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 05:56:22 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-351ab7ed-96f1-4cbe-989f-ca3e2beb2b16 req-3811bf65-dfc6-4a91-87d6-d81912b41212 tempest-AttachVolumeNegativeTest-1214912838 None] attachment_update completed successfully.
Jun 26 05:56:25 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:56:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Flow 'volume_create_manager' (41d47ea3-ddf1-498b-a07d-35acefccca63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:56:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25224d8d-b6b6-4ea9-9faf-6d3b6fa4da98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25224d8d-b6b6-4ea9-9faf-6d3b6fa4da98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-812633797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b881e85f-3247-4b3b-88ff-fce57fc6cf35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0467c0540045f6a0c499c3ad8fa01e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:56:25Z,use_quota=True,user_id='c7301079fd984cf7a4bce2ccf63de347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cebcfbe-87a1-4a14-88a7-78f374634efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cebcfbe-87a1-4a14-88a7-78f374634efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654037bc-928c-42f4-a873-b900445297b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:25 devstack cinder-volume[93708]: DEBUG cinder.image.glance [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Creating Keystone auth plugin from conf {{(pid=93708) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 26 05:56:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654037bc-928c-42f4-a873-b900445297b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b881e85f-3247-4b3b-88ff-fce57fc6cf35', 'volume_name': 'volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35', 'volume_size': 1, 'image_id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '672660d1b01a45828d72fce38b12f1f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'created_at': datetime.datetime(2026, 6, 26, 3, 35, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 3, 35, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfc393ae-7412-4258-bda5-dc0a6732fb07/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf444e9a00>}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b356b3d2-d0f2-4e24-8e7d-80afc763e854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b356b3d2-d0f2-4e24-8e7d-80afc763e854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85df6a8b-042e-4eb0-8082-ec22ebfe9fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:25 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Volume b881e85f-3247-4b3b-88ff-fce57fc6cf35: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35', 'volume_size': 1, 'image_id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '672660d1b01a45828d72fce38b12f1f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'created_at': datetime.datetime(2026, 6, 26, 3, 35, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 3, 35, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfc393ae-7412-4258-bda5-dc0a6732fb07/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf444e9a00>}
Jun 26 05:56:25 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Trying to clone b881e85f-3247-4b3b-88ff-fce57fc6cf35 from image dfc393ae-7412-4258-bda5-dc0a6732fb07 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}]). {{(pid=93708) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 26 05:56:25 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_vz3fmmkmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 26 05:56:25 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Image download 20.69 MB at 20.69 MB/s
Jun 26 05:56:25 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f483848-3e94-43e5-be72-c557929b9d52]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_vz3fmmkmdevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:26 devstack sudo[109168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_vz3fmmkmdevstack@QuobyteHD
Jun 26 05:56:26 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:26 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_vz3fmmkmdevstack@QuobyteHD" returned: 0 in 0.728s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:26 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Temporary image dfc393ae-7412-4258-bda5-dc0a6732fb07 is fetched for user c7301079fd984cf7a4bce2ccf63de347. {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 26 05:56:26 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be033e7-d13b-42db-99f8-221862f2effe]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_vz3fmmkmdevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:26 devstack sudo[109173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_vz3fmmkmdevstack@QuobyteHD
Jun 26 05:56:26 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:27 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_vz3fmmkmdevstack@QuobyteHD" returned: 0 in 0.755s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:56:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:56:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-812633797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b881e85f-3247-4b3b-88ff-fce57fc6cf35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0467c0540045f6a0c499c3ad8fa01e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:56:25Z,use_quota=True,user_id='c7301079fd984cf7a4bce2ccf63de347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:56:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Creating volume b881e85f-3247-4b3b-88ff-fce57fc6cf35 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:56:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:56:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:56:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:56:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:56:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:56:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:56:27 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:56:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:27 devstack sudo[109178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35 1073741824
Jun 26 05:56:27 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:28 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-cfd35856-01dd-47e2-931e-a7133860da60 req-6ec98e08-2eea-4610-ad64-ea5e402d0aa9 tempest-AttachVolumeNegativeTest-1214912838 None] Terminate volume connection completed successfully.
Jun 26 05:56:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-cfd35856-01dd-47e2-931e-a7133860da60 req-6ec98e08-2eea-4610-ad64-ea5e402d0aa9 tempest-AttachVolumeNegativeTest-1214912838 None] Deleting attachment 136d5dc3-c512-4d89-99e6-5c5ab5aa72be. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 05:56:28 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35 1073741824" returned: 0 in 0.873s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:28 devstack sudo[109214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35
Jun 26 05:56:28 devstack sudo[109214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:29 devstack sudo[109214]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35" returned: 0 in 0.652s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:56:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:56:29 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Attempting download of dfc393ae-7412-4258-bda5-dc0a6732fb07 ((None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}])) to volume b881e85f-3247-4b3b-88ff-fce57fc6cf35. {{(pid=93708) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 26 05:56:29 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ede2724-c706-4b98-a8bd-d96cf6793a73]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_lfsf_nk8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:29 devstack sudo[109228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_lfsf_nk8
Jun 26 05:56:29 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:29 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_lfsf_nk8" returned: 0 in 0.727s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_lfsf_nk8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:30 devstack sudo[109257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_lfsf_nk8
Jun 26 05:56:30 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:30 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_lfsf_nk8" returned: 1 in 0.759s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_lfsf_nk8' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 05:56:30 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b8305a-1800-422e-b0ce-e30a07d5cc06]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_vz3fmmkmdevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:30 devstack sudo[109261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_vz3fmmkmdevstack@QuobyteHD
Jun 26 05:56:30 devstack sudo[109261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:31 devstack sudo[109261]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_vz3fmmkmdevstack@QuobyteHD" returned: 0 in 0.741s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:31 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] dfc393ae-7412-4258-bda5-dc0a6732fb07 was qcow2, converting to raw {{(pid=93708) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 26 05:56:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_vz3fmmkmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:31 devstack sudo[109273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_vz3fmmkmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35
Jun 26 05:56:31 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:33 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_vz3fmmkmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35" returned: 0 in 2.017s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:33 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_vz3fmmkmdevstack@QuobyteHD, size 112.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35 {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 05:56:33 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Converted 112.00 MB image at 55.48 MB/s
Jun 26 05:56:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:33 devstack sudo[109318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35 1G
Jun 26 05:56:33 devstack sudo[109318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:34 devstack sudo[109318]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35 1G" returned: 0 in 0.740s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:34 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2a1974-0883-45ce-b46c-bf782b7af566]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:34 devstack sudo[109325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35
Jun 26 05:56:34 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:35 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35" returned: 0 in 0.757s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:35 devstack sudo[109329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35
Jun 26 05:56:35 devstack sudo[109329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:35 devstack sudo[109329]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35" returned: 1 in 0.751s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 05:56:35 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Downloaded image dfc393ae-7412-4258-bda5-dc0a6732fb07 ((None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}])) to volume b881e85f-3247-4b3b-88ff-fce57fc6cf35 successfully. {{(pid=93708) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 26 05:56:35 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Temporary image dfc393ae-7412-4258-bda5-dc0a6732fb07 for user c7301079fd984cf7a4bce2ccf63de347 is deleted. {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 26 05:56:35 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Marking volume b881e85f-3247-4b3b-88ff-fce57fc6cf35 as bootable. {{(pid=93708) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 26 05:56:35 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Copying metadata from image dfc393ae-7412-4258-bda5-dc0a6732fb07 to b881e85f-3247-4b3b-88ff-fce57fc6cf35. {{(pid=93708) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 26 05:56:35 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Creating volume glance metadata for volume b881e85f-3247-4b3b-88ff-fce57fc6cf35 backed by image dfc393ae-7412-4258-bda5-dc0a6732fb07 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93708) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 26 05:56:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85df6a8b-042e-4eb0-8082-ec22ebfe9fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35', 'volume_size': 1, 'image_id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '672660d1b01a45828d72fce38b12f1f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'created_at': datetime.datetime(2026, 6, 26, 3, 35, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 3, 35, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfc393ae-7412-4258-bda5-dc0a6732fb07/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf444e9a00>}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c46ccf4-0658-4656-9b11-03717c88cd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:35 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Volume volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35 (b881e85f-3247-4b3b-88ff-fce57fc6cf35): created successfully
Jun 26 05:56:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c46ccf4-0658-4656-9b11-03717c88cd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Flow 'volume_create_manager' (41d47ea3-ddf1-498b-a07d-35acefccca63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:56:35 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-732efa86-c84c-41ec-a882-c306a77445e7 tempest-VolumesExtendTest-1179651742 None] Created volume successfully.
Jun 26 05:56:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-52de335c-292a-4219-b74a-c31e8132bf7a tempest-VolumesExtendTest-1179651742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:56:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-52de335c-292a-4219-b74a-c31e8132bf7a tempest-VolumesExtendTest-1179651742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:56:36 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[468387c7-40b9-4b99-85cc-191293eb6eb3]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-52de335c-292a-4219-b74a-c31e8132bf7a tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:36 devstack sudo[109334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35
Jun 26 05:56:36 devstack sudo[109334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:36 devstack sudo[109334]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-52de335c-292a-4219-b74a-c31e8132bf7a tempest-VolumesExtendTest-1179651742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35" returned: 0 in 0.764s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-52de335c-292a-4219-b74a-c31e8132bf7a tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:37 devstack sudo[109338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35
Jun 26 05:56:37 devstack sudo[109338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:37 devstack sudo[109338]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-52de335c-292a-4219-b74a-c31e8132bf7a tempest-VolumesExtendTest-1179651742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35" returned: 1 in 0.741s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-52de335c-292a-4219-b74a-c31e8132bf7a tempest-VolumesExtendTest-1179651742 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 05:56:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-52de335c-292a-4219-b74a-c31e8132bf7a tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35 2G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-52de335c-292a-4219-b74a-c31e8132bf7a tempest-VolumesExtendTest-1179651742 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35 2G" returned: 0 in 0.058s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-52de335c-292a-4219-b74a-c31e8132bf7a tempest-VolumesExtendTest-1179651742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.606s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:56:37 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-52de335c-292a-4219-b74a-c31e8132bf7a tempest-VolumesExtendTest-1179651742 None] Extend volume completed successfully.
Jun 26 05:56:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] Acquiring lock "cinder-b881e85f-3247-4b3b-88ff-fce57fc6cf35-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:56:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] Lock "cinder-b881e85f-3247-4b3b-88ff-fce57fc6cf35-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:56:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] Acquiring lock "cinder-quobyte-b881e85f-3247-4b3b-88ff-fce57fc6cf35" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:56:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] Lock "cinder-quobyte-b881e85f-3247-4b3b-88ff-fce57fc6cf35" acquired by "delete_volume" :: waited 0.022s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:56:38 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d53f70-69c0-4cfc-b24f-856e2e8d44e8]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:38 devstack sudo[109346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35
Jun 26 05:56:38 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-16c17ed2-6a4f-4e91-80a1-23d33695a60f tempest-AttachVolumeNegativeTest-1214912838 None] Acquiring lock "cinder-5bd64d72-43e1-44b5-bfa7-87f141866583-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:56:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-16c17ed2-6a4f-4e91-80a1-23d33695a60f tempest-AttachVolumeNegativeTest-1214912838 None] Lock "cinder-5bd64d72-43e1-44b5-bfa7-87f141866583-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:56:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-16c17ed2-6a4f-4e91-80a1-23d33695a60f tempest-AttachVolumeNegativeTest-1214912838 None] Acquiring lock "cinder-quobyte-5bd64d72-43e1-44b5-bfa7-87f141866583" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:56:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-16c17ed2-6a4f-4e91-80a1-23d33695a60f tempest-AttachVolumeNegativeTest-1214912838 None] Lock "cinder-quobyte-5bd64d72-43e1-44b5-bfa7-87f141866583" acquired by "delete_volume" :: waited 0.015s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:56:38 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d77131-7c89-4b02-a5bf-f879b1118c0c]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-16c17ed2-6a4f-4e91-80a1-23d33695a60f tempest-AttachVolumeNegativeTest-1214912838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5bd64d72-43e1-44b5-bfa7-87f141866583 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:39 devstack sudo[109348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5bd64d72-43e1-44b5-bfa7-87f141866583
Jun 26 05:56:39 devstack sudo[109348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:39 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35" returned: 0 in 0.786s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:39 devstack sudo[109352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35
Jun 26 05:56:39 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:39 devstack sudo[109348]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-16c17ed2-6a4f-4e91-80a1-23d33695a60f tempest-AttachVolumeNegativeTest-1214912838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5bd64d72-43e1-44b5-bfa7-87f141866583" returned: 0 in 0.794s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-16c17ed2-6a4f-4e91-80a1-23d33695a60f tempest-AttachVolumeNegativeTest-1214912838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5bd64d72-43e1-44b5-bfa7-87f141866583 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:39 devstack sudo[109357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5bd64d72-43e1-44b5-bfa7-87f141866583
Jun 26 05:56:39 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:40 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35" returned: 1 in 0.770s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 05:56:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:40 devstack sudo[109362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35
Jun 26 05:56:40 devstack sudo[109362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:40 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-16c17ed2-6a4f-4e91-80a1-23d33695a60f tempest-AttachVolumeNegativeTest-1214912838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5bd64d72-43e1-44b5-bfa7-87f141866583" returned: 0 in 0.648s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-16c17ed2-6a4f-4e91-80a1-23d33695a60f tempest-AttachVolumeNegativeTest-1214912838 None] Lock "cinder-quobyte-5bd64d72-43e1-44b5-bfa7-87f141866583" released by "delete_volume" :: held 1.483s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:56:40 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-16c17ed2-6a4f-4e91-80a1-23d33695a60f tempest-AttachVolumeNegativeTest-1214912838 None] Created reservations ['e30f25a5-56f7-443e-8fd4-4e32d7e3759b', 'dbf7f4ea-4b95-4140-9070-9ad9d5d3d406', '1454a4e8-bbca-4421-bf3e-295cadda847f', '0d02ce32-87e7-47ab-9d73-5e9d47e5fb0c'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:56:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-16c17ed2-6a4f-4e91-80a1-23d33695a60f tempest-AttachVolumeNegativeTest-1214912838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:56:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-16c17ed2-6a4f-4e91-80a1-23d33695a60f tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:56:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-16c17ed2-6a4f-4e91-80a1-23d33695a60f tempest-AttachVolumeNegativeTest-1214912838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:56:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-16c17ed2-6a4f-4e91-80a1-23d33695a60f tempest-AttachVolumeNegativeTest-1214912838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:56:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-16c17ed2-6a4f-4e91-80a1-23d33695a60f tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:56:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-16c17ed2-6a4f-4e91-80a1-23d33695a60f tempest-AttachVolumeNegativeTest-1214912838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:40 devstack sudo[109365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:56:40 devstack sudo[109365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:40 devstack sudo[109362]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b881e85f-3247-4b3b-88ff-fce57fc6cf35" returned: 0 in 0.649s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:40 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] Lock "cinder-quobyte-b881e85f-3247-4b3b-88ff-fce57fc6cf35" released by "delete_volume" :: held 2.273s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:56:40 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] Created reservations ['54986578-9dca-475a-9dc8-f5213fa6d6e6', '45a05b39-c4ff-48aa-95c7-07a580acd4a0', 'f5cd94e8-0d13-4053-8c9d-81ebba2eebd2', 'f5e46850-5827-4be0-aac7-7cb766a1291e'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:56:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:56:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:56:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:56:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:56:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:56:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:41 devstack sudo[109368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:56:41 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9e91c421-8eb3-4114-b09f-9462b673d5c7 tempest-AttachVolumeNegativeTest-1214912838 None] Acquiring lock "cinder-2e86ab7e-4119-4686-8353-5d6b1f22b70f-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:56:41 devstack sudo[109365]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-16c17ed2-6a4f-4e91-80a1-23d33695a60f tempest-AttachVolumeNegativeTest-1214912838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.704s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:41 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-16c17ed2-6a4f-4e91-80a1-23d33695a60f tempest-AttachVolumeNegativeTest-1214912838 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:56:41 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-16c17ed2-6a4f-4e91-80a1-23d33695a60f tempest-AttachVolumeNegativeTest-1214912838 None] Deleted volume successfully.
Jun 26 05:56:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9e91c421-8eb3-4114-b09f-9462b673d5c7 tempest-AttachVolumeNegativeTest-1214912838 None] Lock "cinder-2e86ab7e-4119-4686-8353-5d6b1f22b70f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:56:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-16c17ed2-6a4f-4e91-80a1-23d33695a60f tempest-AttachVolumeNegativeTest-1214912838 None] Lock "cinder-5bd64d72-43e1-44b5-bfa7-87f141866583-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:56:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9e91c421-8eb3-4114-b09f-9462b673d5c7 tempest-AttachVolumeNegativeTest-1214912838 None] Acquiring lock "cinder-quobyte-2e86ab7e-4119-4686-8353-5d6b1f22b70f" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:56:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9e91c421-8eb3-4114-b09f-9462b673d5c7 tempest-AttachVolumeNegativeTest-1214912838 None] Lock "cinder-quobyte-2e86ab7e-4119-4686-8353-5d6b1f22b70f" acquired by "delete_volume" :: waited 0.014s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:56:41 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ac5dae-304f-4e67-8401-175df56f1957]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9e91c421-8eb3-4114-b09f-9462b673d5c7 tempest-AttachVolumeNegativeTest-1214912838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2e86ab7e-4119-4686-8353-5d6b1f22b70f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:41 devstack sudo[109371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2e86ab7e-4119-4686-8353-5d6b1f22b70f
Jun 26 05:56:41 devstack sudo[109371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:41 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.666s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:41 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:56:41 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] Deleted volume successfully.
Jun 26 05:56:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-f1031be3-6b4d-4007-9990-01fcb4f6cedd tempest-VolumesExtendTest-1179651742 None] Lock "cinder-b881e85f-3247-4b3b-88ff-fce57fc6cf35-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:56:42 devstack sudo[109371]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9e91c421-8eb3-4114-b09f-9462b673d5c7 tempest-AttachVolumeNegativeTest-1214912838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2e86ab7e-4119-4686-8353-5d6b1f22b70f" returned: 0 in 0.802s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9e91c421-8eb3-4114-b09f-9462b673d5c7 tempest-AttachVolumeNegativeTest-1214912838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2e86ab7e-4119-4686-8353-5d6b1f22b70f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:42 devstack sudo[109378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2e86ab7e-4119-4686-8353-5d6b1f22b70f
Jun 26 05:56:42 devstack sudo[109378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Flow 'volume_create_manager' (28731ac9-93ce-4300-b22f-6714f475eecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d355df-ce00-4539-9c4f-89063bbd4e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d355df-ce00-4539-9c4f-89063bbd4e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-558807762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4df669-0f5d-4b93-8e6c-493174e94b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0467c0540045f6a0c499c3ad8fa01e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:56:42Z,use_quota=True,user_id='c7301079fd984cf7a4bce2ccf63de347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4bb0473-7411-4005-934c-15630aeb89f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4bb0473-7411-4005-934c-15630aeb89f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5361b9-e33d-40b6-a47e-b7f9a11695ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5361b9-e33d-40b6-a47e-b7f9a11695ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b4df669-0f5d-4b93-8e6c-493174e94b38', 'volume_name': 'volume-7b4df669-0f5d-4b93-8e6c-493174e94b38', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7b62c4-6998-4969-92ee-cdfcd3a4d475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7b62c4-6998-4969-92ee-cdfcd3a4d475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac41e2e-0433-40ce-97c7-e26bf485cfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:42 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Volume 7b4df669-0f5d-4b93-8e6c-493174e94b38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b4df669-0f5d-4b93-8e6c-493174e94b38', 'volume_size': 1}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-558807762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4df669-0f5d-4b93-8e6c-493174e94b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0467c0540045f6a0c499c3ad8fa01e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:56:42Z,use_quota=True,user_id='c7301079fd984cf7a4bce2ccf63de347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Creating volume 7b4df669-0f5d-4b93-8e6c-493174e94b38 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:56:42 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:42 devstack sudo[109380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38 1073741824
Jun 26 05:56:42 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:42 devstack sudo[109378]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9e91c421-8eb3-4114-b09f-9462b673d5c7 tempest-AttachVolumeNegativeTest-1214912838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-2e86ab7e-4119-4686-8353-5d6b1f22b70f" returned: 0 in 0.687s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9e91c421-8eb3-4114-b09f-9462b673d5c7 tempest-AttachVolumeNegativeTest-1214912838 None] Lock "cinder-quobyte-2e86ab7e-4119-4686-8353-5d6b1f22b70f" released by "delete_volume" :: held 1.533s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-9e91c421-8eb3-4114-b09f-9462b673d5c7 tempest-AttachVolumeNegativeTest-1214912838 None] Created reservations ['440494c7-af7b-4414-966a-84754e2cc74f', '919b0a8f-4dcc-4a94-8f98-7d768c44df4e', '8d163ce2-d486-4762-8712-92f8fff5cd4f', '978ca996-db99-4cbf-a1f5-6c7a4c132636'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9e91c421-8eb3-4114-b09f-9462b673d5c7 tempest-AttachVolumeNegativeTest-1214912838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9e91c421-8eb3-4114-b09f-9462b673d5c7 tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9e91c421-8eb3-4114-b09f-9462b673d5c7 tempest-AttachVolumeNegativeTest-1214912838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9e91c421-8eb3-4114-b09f-9462b673d5c7 tempest-AttachVolumeNegativeTest-1214912838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9e91c421-8eb3-4114-b09f-9462b673d5c7 tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:56:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9e91c421-8eb3-4114-b09f-9462b673d5c7 tempest-AttachVolumeNegativeTest-1214912838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:42 devstack sudo[109386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:56:42 devstack sudo[109386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:43 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38 1073741824" returned: 0 in 0.880s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:43 devstack sudo[109389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38
Jun 26 05:56:43 devstack sudo[109389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:43 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-edb672b8-e3a2-43a0-8cb3-a23941c7ea0d tempest-AttachVolumeNegativeTest-1214912838 None] Acquiring lock "cinder-1de22793-7f50-4838-b4ef-eb44579f6810-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:56:43 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-edb672b8-e3a2-43a0-8cb3-a23941c7ea0d tempest-AttachVolumeNegativeTest-1214912838 None] Lock "cinder-1de22793-7f50-4838-b4ef-eb44579f6810-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:56:43 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-edb672b8-e3a2-43a0-8cb3-a23941c7ea0d tempest-AttachVolumeNegativeTest-1214912838 None] Acquiring lock "cinder-quobyte-1de22793-7f50-4838-b4ef-eb44579f6810" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:56:43 devstack sudo[109386]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9e91c421-8eb3-4114-b09f-9462b673d5c7 tempest-AttachVolumeNegativeTest-1214912838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.753s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:43 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-9e91c421-8eb3-4114-b09f-9462b673d5c7 tempest-AttachVolumeNegativeTest-1214912838 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:56:43 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-edb672b8-e3a2-43a0-8cb3-a23941c7ea0d tempest-AttachVolumeNegativeTest-1214912838 None] Lock "cinder-quobyte-1de22793-7f50-4838-b4ef-eb44579f6810" acquired by "delete_volume" :: waited 0.022s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:56:43 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-9e91c421-8eb3-4114-b09f-9462b673d5c7 tempest-AttachVolumeNegativeTest-1214912838 None] Deleted volume successfully.
Jun 26 05:56:43 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9e91c421-8eb3-4114-b09f-9462b673d5c7 tempest-AttachVolumeNegativeTest-1214912838 None] Lock "cinder-2e86ab7e-4119-4686-8353-5d6b1f22b70f-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:56:43 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[559ff2bb-4319-4bc8-964d-5d0c9aa03d89]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-edb672b8-e3a2-43a0-8cb3-a23941c7ea0d tempest-AttachVolumeNegativeTest-1214912838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1de22793-7f50-4838-b4ef-eb44579f6810 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:43 devstack sudo[109392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1de22793-7f50-4838-b4ef-eb44579f6810
Jun 26 05:56:43 devstack sudo[109392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:43 devstack sudo[109389]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38" returned: 0 in 0.714s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:43 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:56:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:56:43 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac41e2e-0433-40ce-97c7-e26bf485cfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b4df669-0f5d-4b93-8e6c-493174e94b38', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:43 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c843945d-51b0-44a6-afab-c66fccf09d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:43 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Volume volume-7b4df669-0f5d-4b93-8e6c-493174e94b38 (7b4df669-0f5d-4b93-8e6c-493174e94b38): created successfully
Jun 26 05:56:43 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c843945d-51b0-44a6-afab-c66fccf09d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:43 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Flow 'volume_create_manager' (28731ac9-93ce-4300-b22f-6714f475eecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:56:43 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-7e06006b-fa76-4fda-8cee-9ed1ebebe8d4 tempest-VolumesExtendTest-1179651742 None] Created volume successfully.
Jun 26 05:56:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-82270e71-472c-4ab5-a9bf-3b2b944d4bc3 tempest-VolumesExtendTest-1179651742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:56:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-82270e71-472c-4ab5-a9bf-3b2b944d4bc3 tempest-VolumesExtendTest-1179651742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:56:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-82270e71-472c-4ab5-a9bf-3b2b944d4bc3 tempest-VolumesExtendTest-1179651742 None] Creating offline snapshot 20b6c043-f88e-48e1-849e-98a748fee126 of volume 7b4df669-0f5d-4b93-8e6c-493174e94b38 {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:56:44 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba2c8d4-6db5-4767-84a0-d8cd78a46250]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-82270e71-472c-4ab5-a9bf-3b2b944d4bc3 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:44 devstack sudo[109392]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-edb672b8-e3a2-43a0-8cb3-a23941c7ea0d tempest-AttachVolumeNegativeTest-1214912838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1de22793-7f50-4838-b4ef-eb44579f6810" returned: 0 in 0.814s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-edb672b8-e3a2-43a0-8cb3-a23941c7ea0d tempest-AttachVolumeNegativeTest-1214912838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1de22793-7f50-4838-b4ef-eb44579f6810 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:44 devstack sudo[109399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1de22793-7f50-4838-b4ef-eb44579f6810
Jun 26 05:56:44 devstack sudo[109399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:44 devstack sudo[109398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38
Jun 26 05:56:44 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:45 devstack sudo[109399]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-edb672b8-e3a2-43a0-8cb3-a23941c7ea0d tempest-AttachVolumeNegativeTest-1214912838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-1de22793-7f50-4838-b4ef-eb44579f6810" returned: 0 in 0.678s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:45 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-edb672b8-e3a2-43a0-8cb3-a23941c7ea0d tempest-AttachVolumeNegativeTest-1214912838 None] Lock "cinder-quobyte-1de22793-7f50-4838-b4ef-eb44579f6810" released by "delete_volume" :: held 1.565s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:56:45 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-82270e71-472c-4ab5-a9bf-3b2b944d4bc3 tempest-VolumesExtendTest-1179651742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38" returned: 0 in 0.779s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-82270e71-472c-4ab5-a9bf-3b2b944d4bc3 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:45 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-edb672b8-e3a2-43a0-8cb3-a23941c7ea0d tempest-AttachVolumeNegativeTest-1214912838 None] Created reservations ['7a85e681-18af-4d37-a4d0-0737acf8df63', '0353df61-e7b0-47db-acc3-5b2e623bf63b', 'aa673ce2-7f78-4e66-9840-e70dc5d3785f', '0b9933e4-e11e-4ebe-a461-61b7fc3373a5'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:56:45 devstack sudo[109407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126 1G
Jun 26 05:56:45 devstack sudo[109407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-edb672b8-e3a2-43a0-8cb3-a23941c7ea0d tempest-AttachVolumeNegativeTest-1214912838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:56:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-edb672b8-e3a2-43a0-8cb3-a23941c7ea0d tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:56:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-edb672b8-e3a2-43a0-8cb3-a23941c7ea0d tempest-AttachVolumeNegativeTest-1214912838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:56:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-edb672b8-e3a2-43a0-8cb3-a23941c7ea0d tempest-AttachVolumeNegativeTest-1214912838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:56:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-edb672b8-e3a2-43a0-8cb3-a23941c7ea0d tempest-AttachVolumeNegativeTest-1214912838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:56:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-edb672b8-e3a2-43a0-8cb3-a23941c7ea0d tempest-AttachVolumeNegativeTest-1214912838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:45 devstack sudo[109409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:56:45 devstack sudo[109409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:46 devstack sudo[109409]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-edb672b8-e3a2-43a0-8cb3-a23941c7ea0d tempest-AttachVolumeNegativeTest-1214912838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.705s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:46 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-edb672b8-e3a2-43a0-8cb3-a23941c7ea0d tempest-AttachVolumeNegativeTest-1214912838 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:56:46 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-edb672b8-e3a2-43a0-8cb3-a23941c7ea0d tempest-AttachVolumeNegativeTest-1214912838 None] Deleted volume successfully.
Jun 26 05:56:46 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-edb672b8-e3a2-43a0-8cb3-a23941c7ea0d tempest-AttachVolumeNegativeTest-1214912838 None] Lock "cinder-1de22793-7f50-4838-b4ef-eb44579f6810-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:56:46 devstack sudo[109407]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-82270e71-472c-4ab5-a9bf-3b2b944d4bc3 tempest-VolumesExtendTest-1179651742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126 1G" returned: 0 in 0.863s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-82270e71-472c-4ab5-a9bf-3b2b944d4bc3 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b4df669-0f5d-4b93-8e6c-493174e94b38 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:46 devstack sudo[109415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b4df669-0f5d-4b93-8e6c-493174e94b38 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126
Jun 26 05:56:46 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:46 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-82270e71-472c-4ab5-a9bf-3b2b944d4bc3 tempest-VolumesExtendTest-1179651742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b4df669-0f5d-4b93-8e6c-493174e94b38 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126" returned: 0 in 0.775s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:46 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-82270e71-472c-4ab5-a9bf-3b2b944d4bc3 tempest-VolumesExtendTest-1179651742 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126 is being set with open permissions: ugo+rw
Jun 26 05:56:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-82270e71-472c-4ab5-a9bf-3b2b944d4bc3 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:46 devstack sudo[109420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126
Jun 26 05:56:46 devstack sudo[109420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:47 devstack sudo[109420]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-82270e71-472c-4ab5-a9bf-3b2b944d4bc3 tempest-VolumesExtendTest-1179651742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126" returned: 0 in 0.681s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-82270e71-472c-4ab5-a9bf-3b2b944d4bc3 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:47 devstack sudo[109424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.info
Jun 26 05:56:47 devstack sudo[109424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:48 devstack sudo[109424]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-82270e71-472c-4ab5-a9bf-3b2b944d4bc3 tempest-VolumesExtendTest-1179651742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.info" returned: 0 in 0.659s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:48 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-82270e71-472c-4ab5-a9bf-3b2b944d4bc3 tempest-VolumesExtendTest-1179651742 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.info is being set with open permissions: ugo+rw
Jun 26 05:56:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-82270e71-472c-4ab5-a9bf-3b2b944d4bc3 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:48 devstack sudo[109427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.info
Jun 26 05:56:48 devstack sudo[109427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:49 devstack sudo[109427]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-82270e71-472c-4ab5-a9bf-3b2b944d4bc3 tempest-VolumesExtendTest-1179651742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.info" returned: 0 in 0.768s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-82270e71-472c-4ab5-a9bf-3b2b944d4bc3 tempest-VolumesExtendTest-1179651742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.623s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:56:49 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=66,cinder:UPDATE=79,cinder:DELETE=5,cinder:INSERT=22 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:56:49 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=66,cinder:INSERT=27,cinder:UPDATE=77,cinder:DELETE=5 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:56:49 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-82270e71-472c-4ab5-a9bf-3b2b944d4bc3 tempest-VolumesExtendTest-1179651742 None] Create snapshot completed successfully
Jun 26 05:56:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e7b71214-da92-429f-a2a1-110c6bc2a726 tempest-VolumesExtendTest-1179651742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:56:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e7b71214-da92-429f-a2a1-110c6bc2a726 tempest-VolumesExtendTest-1179651742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:56:49 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa8a630-fe45-4083-8571-b3c46ff444e8]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e7b71214-da92-429f-a2a1-110c6bc2a726 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:49 devstack sudo[109431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38
Jun 26 05:56:49 devstack sudo[109431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:50 devstack sudo[109431]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e7b71214-da92-429f-a2a1-110c6bc2a726 tempest-VolumesExtendTest-1179651742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38" returned: 0 in 0.816s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e7b71214-da92-429f-a2a1-110c6bc2a726 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126 2G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e7b71214-da92-429f-a2a1-110c6bc2a726 tempest-VolumesExtendTest-1179651742 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126 2G" returned: 0 in 0.128s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e7b71214-da92-429f-a2a1-110c6bc2a726 tempest-VolumesExtendTest-1179651742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.980s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:56:50 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e7b71214-da92-429f-a2a1-110c6bc2a726 tempest-VolumesExtendTest-1179651742 None] Extend volume completed successfully.
Jun 26 05:56:51 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] Acquiring lock "cinder-20b6c043-f88e-48e1-849e-98a748fee126-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:56:51 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] Lock "cinder-20b6c043-f88e-48e1-849e-98a748fee126-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:56:51 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] Acquiring lock "cinder-quobyte-7b4df669-0f5d-4b93-8e6c-493174e94b38" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:56:51 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] Lock "cinder-quobyte-7b4df669-0f5d-4b93-8e6c-493174e94b38" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:56:51 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] Acquiring lock "cinder-quobyte-20b6c043-f88e-48e1-849e-98a748fee126" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:56:51 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] Lock "cinder-quobyte-20b6c043-f88e-48e1-849e-98a748fee126" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:56:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] Deleting offline snapshot 20b6c043-f88e-48e1-849e-98a748fee126 of volume 7b4df669-0f5d-4b93-8e6c-493174e94b38 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:56:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] snapshot_file for this snap is: volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:56:51 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9759aa-705e-4fd8-9a4b-7d8bd9adfd09]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:51 devstack sudo[109440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126
Jun 26 05:56:51 devstack sudo[109440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:51 devstack sudo[109440]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126" returned: 0 in 0.808s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b4df669-0f5d-4b93-8e6c-493174e94b38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:56:51 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d10e3a-a006-48ae-a616-190c781005a0]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:52 devstack sudo[109445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38
Jun 26 05:56:52 devstack sudo[109445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:52 devstack sudo[109445]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38" returned: 0 in 0.783s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:52 devstack sudo[109451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126
Jun 26 05:56:52 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:52 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-51b21a86-500f-4f2b-9fbd-fcdc7463545e tempest-GroupSnapshotsV319Test-1604552887 None] Group tempest-GroupSnapshotsV319Test-Group-1622569576: creating
Jun 26 05:56:52 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-51b21a86-500f-4f2b-9fbd-fcdc7463545e tempest-GroupSnapshotsV319Test-1604552887 None] Group tempest-GroupSnapshotsV319Test-Group-1622569576: created successfully
Jun 26 05:56:52 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-51b21a86-500f-4f2b-9fbd-fcdc7463545e tempest-GroupSnapshotsV319Test-1604552887 None] Create group completed successfully.
Jun 26 05:56:53 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126" returned: 0 in 0.765s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:53 devstack sudo[109457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126
Jun 26 05:56:53 devstack sudo[109457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:54 devstack sudo[109457]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38.20b6c043-f88e-48e1-849e-98a748fee126" returned: 0 in 0.646s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] Lock "cinder-quobyte-20b6c043-f88e-48e1-849e-98a748fee126" released by "_delete_snapshot" :: held 3.159s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] Lock "cinder-quobyte-7b4df669-0f5d-4b93-8e6c-493174e94b38" released by "delete_snapshot" :: held 3.191s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] Created reservations ['919ac652-742c-48df-98f6-210c602193b7', '12c4aac5-fa5c-4628-a3a0-b90b6fcf4f36', '29e45755-5aea-4a73-ba26-9fbc726fb523', 'e06b8fd2-6264-42a3-9fc6-be94b6030e60'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:56:54 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] Delete snapshot completed successfully.
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a5ecd6b8-4829-4297-a7dd-2bd5388d7335 tempest-VolumesExtendTest-1179651742 None] Lock "cinder-20b6c043-f88e-48e1-849e-98a748fee126-delete_snapshot" released by "delete_snapshot" :: held 3.387s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Flow 'volume_create_manager' (ae0d1a09-23ef-44e0-a0e3-75accd012dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3f7537-abe3-488d-965d-ad5797c99a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3f7537-abe3-488d-965d-ad5797c99a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-472167761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3ea28fe3-5e42-4dba-ad8a-9765f9cf233a,host='devstack@QuobyteHD#QuobyteHD',id=9efe2c8d-1fe0-4460-9882-1e3fd20e34fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef10bd1e2b243929a5de7b0bed385dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:56:54Z,use_quota=True,user_id='93a537e1b8bb4a43916c93ff2078dc5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(080426ab-f75a-425d-96ce-fe218726aeac),volume_type_id=080426ab-f75a-425d-96ce-fe218726aeac)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d30bdb5-0dac-4f9f-a787-f7be1009ec9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d30bdb5-0dac-4f9f-a787-f7be1009ec9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd2a53d7-2ef1-41f5-8105-3ae80d4aeab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd2a53d7-2ef1-41f5-8105-3ae80d4aeab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9efe2c8d-1fe0-4460-9882-1e3fd20e34fd', 'volume_name': 'volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f69ad6-d7ae-40ef-8e68-602ee1da8947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f69ad6-d7ae-40ef-8e68-602ee1da8947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a21d36-d33e-41af-9789-da8f67e306d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:54 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Volume 9efe2c8d-1fe0-4460-9882-1e3fd20e34fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd', 'volume_size': 1}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3ea28fe3-5e42-4dba-ad8a-9765f9cf233a,created_at=2026-06-26T03:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-472167761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3ea28fe3-5e42-4dba-ad8a-9765f9cf233a,host='devstack@QuobyteHD#QuobyteHD',id=9efe2c8d-1fe0-4460-9882-1e3fd20e34fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef10bd1e2b243929a5de7b0bed385dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:56:54Z,use_quota=True,user_id='93a537e1b8bb4a43916c93ff2078dc5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(080426ab-f75a-425d-96ce-fe218726aeac),volume_type_id=080426ab-f75a-425d-96ce-fe218726aeac)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Creating volume 9efe2c8d-1fe0-4460-9882-1e3fd20e34fd {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:56:54 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:56:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:54 devstack sudo[109460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd 1073741824
Jun 26 05:56:54 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-aa6ebbb2-7d2e-4b0a-a58f-6c679819a64d tempest-VolumesExtendTest-1179651742 None] Acquiring lock "cinder-7b4df669-0f5d-4b93-8e6c-493174e94b38-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:56:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-aa6ebbb2-7d2e-4b0a-a58f-6c679819a64d tempest-VolumesExtendTest-1179651742 None] Lock "cinder-7b4df669-0f5d-4b93-8e6c-493174e94b38-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:56:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-aa6ebbb2-7d2e-4b0a-a58f-6c679819a64d tempest-VolumesExtendTest-1179651742 None] Acquiring lock "cinder-quobyte-7b4df669-0f5d-4b93-8e6c-493174e94b38" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:56:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-aa6ebbb2-7d2e-4b0a-a58f-6c679819a64d tempest-VolumesExtendTest-1179651742 None] Lock "cinder-quobyte-7b4df669-0f5d-4b93-8e6c-493174e94b38" acquired by "delete_volume" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:56:55 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd 1073741824" returned: 0 in 0.893s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:55 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[7328b7fa-06b0-4805-a754-d4afd082bafd]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-aa6ebbb2-7d2e-4b0a-a58f-6c679819a64d tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:55 devstack sudo[109467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd
Jun 26 05:56:55 devstack sudo[109467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:55 devstack sudo[109466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38
Jun 26 05:56:55 devstack sudo[109466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:56 devstack sudo[109467]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd" returned: 0 in 0.651s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:56 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:56:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:56:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a21d36-d33e-41af-9789-da8f67e306d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca36778f-3d2d-4803-8f23-af544dfbb7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:56:56 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Volume volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd (9efe2c8d-1fe0-4460-9882-1e3fd20e34fd): created successfully
Jun 26 05:56:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca36778f-3d2d-4803-8f23-af544dfbb7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:56:56 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Flow 'volume_create_manager' (ae0d1a09-23ef-44e0-a0e3-75accd012dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:56:56 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-917ade89-48dc-40da-a3e9-271af0271028 tempest-GroupSnapshotsV319Test-1604552887 None] Created volume successfully.
Jun 26 05:56:56 devstack sudo[109466]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-aa6ebbb2-7d2e-4b0a-a58f-6c679819a64d tempest-VolumesExtendTest-1179651742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38" returned: 0 in 0.798s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-aa6ebbb2-7d2e-4b0a-a58f-6c679819a64d tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:56 devstack sudo[109474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38
Jun 26 05:56:56 devstack sudo[109474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:56 devstack sudo[109474]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-aa6ebbb2-7d2e-4b0a-a58f-6c679819a64d tempest-VolumesExtendTest-1179651742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7b4df669-0f5d-4b93-8e6c-493174e94b38" returned: 0 in 0.638s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:56 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-aa6ebbb2-7d2e-4b0a-a58f-6c679819a64d tempest-VolumesExtendTest-1179651742 None] Lock "cinder-quobyte-7b4df669-0f5d-4b93-8e6c-493174e94b38" released by "delete_volume" :: held 1.497s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:56:56 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-aa6ebbb2-7d2e-4b0a-a58f-6c679819a64d tempest-VolumesExtendTest-1179651742 None] Created reservations ['67d794fd-ca2a-4a5c-a0a7-520a5f29bdb4', 'dc412b2e-b599-4d9d-a1b2-5065649f4fb1', '9e3e3ca4-7a38-43c2-8eb5-ef374b6c0653', '9863cc2f-9a9b-4453-9742-58f27da13b49'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:56:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-aa6ebbb2-7d2e-4b0a-a58f-6c679819a64d tempest-VolumesExtendTest-1179651742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:56:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-aa6ebbb2-7d2e-4b0a-a58f-6c679819a64d tempest-VolumesExtendTest-1179651742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:56:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-aa6ebbb2-7d2e-4b0a-a58f-6c679819a64d tempest-VolumesExtendTest-1179651742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:56:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-aa6ebbb2-7d2e-4b0a-a58f-6c679819a64d tempest-VolumesExtendTest-1179651742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:56:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-aa6ebbb2-7d2e-4b0a-a58f-6c679819a64d tempest-VolumesExtendTest-1179651742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:56:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-aa6ebbb2-7d2e-4b0a-a58f-6c679819a64d tempest-VolumesExtendTest-1179651742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:57 devstack sudo[109477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:56:57 devstack sudo[109477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:57 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-9620a99e-8c79-41a5-b452-9310f72fd86e tempest-GroupSnapshotsV319Test-1604552887 None] GroupSnapshot 2d5fd89d-88ec-4cdf-a16c-cf81f56bf3da: creating.
Jun 26 05:56:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9620a99e-8c79-41a5-b452-9310f72fd86e tempest-GroupSnapshotsV319Test-1604552887 None] Group snapshot 2d5fd89d-88ec-4cdf-a16c-cf81f56bf3da: creating. {{(pid=93708) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 26 05:56:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9620a99e-8c79-41a5-b452-9310f72fd86e tempest-GroupSnapshotsV319Test-1604552887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:56:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9620a99e-8c79-41a5-b452-9310f72fd86e tempest-GroupSnapshotsV319Test-1604552887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:56:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-9620a99e-8c79-41a5-b452-9310f72fd86e tempest-GroupSnapshotsV319Test-1604552887 None] Creating offline snapshot 2da8bb39-c813-42b4-bd73-58739aeac0a8 of volume 9efe2c8d-1fe0-4460-9882-1e3fd20e34fd {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:56:57 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e74795a-57a4-4b67-9aea-e84b6f64cfa4]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:56:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9620a99e-8c79-41a5-b452-9310f72fd86e tempest-GroupSnapshotsV319Test-1604552887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:57 devstack sudo[109479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd
Jun 26 05:56:57 devstack sudo[109479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:57 devstack sudo[109477]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-aa6ebbb2-7d2e-4b0a-a58f-6c679819a64d tempest-VolumesExtendTest-1179651742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.636s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:57 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-aa6ebbb2-7d2e-4b0a-a58f-6c679819a64d tempest-VolumesExtendTest-1179651742 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:56:57 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-aa6ebbb2-7d2e-4b0a-a58f-6c679819a64d tempest-VolumesExtendTest-1179651742 None] Deleted volume successfully.
Jun 26 05:56:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-aa6ebbb2-7d2e-4b0a-a58f-6c679819a64d tempest-VolumesExtendTest-1179651742 None] Lock "cinder-7b4df669-0f5d-4b93-8e6c-493174e94b38-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:56:57 devstack sudo[109479]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9620a99e-8c79-41a5-b452-9310f72fd86e tempest-GroupSnapshotsV319Test-1604552887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd" returned: 0 in 0.797s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9620a99e-8c79-41a5-b452-9310f72fd86e tempest-GroupSnapshotsV319Test-1604552887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.2da8bb39-c813-42b4-bd73-58739aeac0a8 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:57 devstack sudo[109485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.2da8bb39-c813-42b4-bd73-58739aeac0a8 1G
Jun 26 05:56:57 devstack sudo[109485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:58 devstack sudo[109485]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9620a99e-8c79-41a5-b452-9310f72fd86e tempest-GroupSnapshotsV319Test-1604552887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.2da8bb39-c813-42b4-bd73-58739aeac0a8 1G" returned: 0 in 0.901s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9620a99e-8c79-41a5-b452-9310f72fd86e tempest-GroupSnapshotsV319Test-1604552887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.2da8bb39-c813-42b4-bd73-58739aeac0a8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:58 devstack sudo[109491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.2da8bb39-c813-42b4-bd73-58739aeac0a8
Jun 26 05:56:58 devstack sudo[109491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:56:59 devstack sudo[109491]: pam_unix(sudo:session): session closed for user root
Jun 26 05:56:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9620a99e-8c79-41a5-b452-9310f72fd86e tempest-GroupSnapshotsV319Test-1604552887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.2da8bb39-c813-42b4-bd73-58739aeac0a8" returned: 0 in 0.761s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:56:59 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-9620a99e-8c79-41a5-b452-9310f72fd86e tempest-GroupSnapshotsV319Test-1604552887 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.2da8bb39-c813-42b4-bd73-58739aeac0a8 is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 05:56:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9620a99e-8c79-41a5-b452-9310f72fd86e tempest-GroupSnapshotsV319Test-1604552887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.2da8bb39-c813-42b4-bd73-58739aeac0a8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:56:59 devstack sudo[109496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.2da8bb39-c813-42b4-bd73-58739aeac0a8
Jun 26 05:56:59 devstack sudo[109496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:00 devstack sudo[109496]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9620a99e-8c79-41a5-b452-9310f72fd86e tempest-GroupSnapshotsV319Test-1604552887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.2da8bb39-c813-42b4-bd73-58739aeac0a8" returned: 0 in 0.687s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9620a99e-8c79-41a5-b452-9310f72fd86e tempest-GroupSnapshotsV319Test-1604552887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:00 devstack sudo[109499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.info
Jun 26 05:57:00 devstack sudo[109499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:01 devstack sudo[109499]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9620a99e-8c79-41a5-b452-9310f72fd86e tempest-GroupSnapshotsV319Test-1604552887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.info" returned: 0 in 0.698s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:01 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-9620a99e-8c79-41a5-b452-9310f72fd86e tempest-GroupSnapshotsV319Test-1604552887 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 26 05:57:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9620a99e-8c79-41a5-b452-9310f72fd86e tempest-GroupSnapshotsV319Test-1604552887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:01 devstack sudo[109508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.info
Jun 26 05:57:01 devstack sudo[109508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:01 devstack sudo[109508]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9620a99e-8c79-41a5-b452-9310f72fd86e tempest-GroupSnapshotsV319Test-1604552887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.info" returned: 0 in 0.710s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9620a99e-8c79-41a5-b452-9310f72fd86e tempest-GroupSnapshotsV319Test-1604552887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.640s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:57:01 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-9620a99e-8c79-41a5-b452-9310f72fd86e tempest-GroupSnapshotsV319Test-1604552887 None] group_snapshot 2d5fd89d-88ec-4cdf-a16c-cf81f56bf3da: created successfully
Jun 26 05:57:02 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] group_snapshot 2d5fd89d-88ec-4cdf-a16c-cf81f56bf3da: deleting
Jun 26 05:57:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] group_snapshot 2d5fd89d-88ec-4cdf-a16c-cf81f56bf3da: deleting {{(pid=93708) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 26 05:57:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] Acquiring lock "cinder-quobyte-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:57:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] Lock "cinder-quobyte-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:57:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] Acquiring lock "cinder-quobyte-2da8bb39-c813-42b4-bd73-58739aeac0a8" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:57:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] Lock "cinder-quobyte-2da8bb39-c813-42b4-bd73-58739aeac0a8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:57:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] Deleting offline snapshot 2da8bb39-c813-42b4-bd73-58739aeac0a8 of volume 9efe2c8d-1fe0-4460-9882-1e3fd20e34fd {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:57:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] snapshot_file for this snap is: volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.2da8bb39-c813-42b4-bd73-58739aeac0a8 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:57:02 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c0130b-fd75-4f16-aa2d-603e5d5afee0]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:57:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.2da8bb39-c813-42b4-bd73-58739aeac0a8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:03 devstack sudo[109515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.2da8bb39-c813-42b4-bd73-58739aeac0a8
Jun 26 05:57:03 devstack sudo[109515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:03 devstack sudo[109515]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.2da8bb39-c813-42b4-bd73-58739aeac0a8" returned: 0 in 0.813s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:03 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:57:03 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[024e2810-83fa-4fe2-bc58-9f496a8c8be3]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:57:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:03 devstack sudo[109520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd
Jun 26 05:57:03 devstack sudo[109520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:04 devstack sudo[109520]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd" returned: 0 in 0.836s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.2da8bb39-c813-42b4-bd73-58739aeac0a8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:04 devstack sudo[109527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.2da8bb39-c813-42b4-bd73-58739aeac0a8
Jun 26 05:57:04 devstack sudo[109527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:05 devstack sudo[109527]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.2da8bb39-c813-42b4-bd73-58739aeac0a8" returned: 0 in 0.745s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.2da8bb39-c813-42b4-bd73-58739aeac0a8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:05 devstack sudo[109532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.2da8bb39-c813-42b4-bd73-58739aeac0a8
Jun 26 05:57:05 devstack sudo[109532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:06 devstack sudo[109532]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd.2da8bb39-c813-42b4-bd73-58739aeac0a8" returned: 0 in 0.813s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] Lock "cinder-quobyte-2da8bb39-c813-42b4-bd73-58739aeac0a8" released by "_delete_snapshot" :: held 3.327s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:57:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] Lock "cinder-quobyte-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd" released by "delete_snapshot" :: held 3.350s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:57:06 devstack cinder-volume[93708]: WARNING cinder.quota [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1464425850 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1464425850, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:57:06 devstack cinder-volume[93708]: WARNING cinder.quota [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1464425850 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1464425850, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:57:06 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] Created reservations ['f74c6a54-f7d7-413a-9ab0-ebd8f34c1250', 'c8675461-707f-4060-95c7-21835b8ae183', 'a0bf0155-776d-46f4-b252-02f71c9f6f98', '07cc3c7e-5113-4690-9856-4759c28c3bcf'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:57:06 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-ad4da864-497d-4264-86da-7bd7bf5aeb42 tempest-GroupSnapshotsV319Test-1604552887 None] group_snapshot 2d5fd89d-88ec-4cdf-a16c-cf81f56bf3da: deleted successfully
Jun 26 05:57:07 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-743a6c3e-4f52-4825-8523-a30b59c0b280 tempest-GroupSnapshotsV319Test-1604552887 None] Acquiring lock "cinder-quobyte-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:57:07 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-743a6c3e-4f52-4825-8523-a30b59c0b280 tempest-GroupSnapshotsV319Test-1604552887 None] Lock "cinder-quobyte-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd" acquired by "delete_volume" :: waited 0.021s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:57:07 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[5777c1d6-51f2-4eed-a665-5ffb4b59cbc1]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:57:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-743a6c3e-4f52-4825-8523-a30b59c0b280 tempest-GroupSnapshotsV319Test-1604552887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:07 devstack sudo[109535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd
Jun 26 05:57:07 devstack sudo[109535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:08 devstack sudo[109535]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-743a6c3e-4f52-4825-8523-a30b59c0b280 tempest-GroupSnapshotsV319Test-1604552887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd" returned: 0 in 0.817s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-743a6c3e-4f52-4825-8523-a30b59c0b280 tempest-GroupSnapshotsV319Test-1604552887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:08 devstack sudo[109540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd
Jun 26 05:57:08 devstack sudo[109540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:09 devstack sudo[109540]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-743a6c3e-4f52-4825-8523-a30b59c0b280 tempest-GroupSnapshotsV319Test-1604552887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd" returned: 0 in 0.664s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:09 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-743a6c3e-4f52-4825-8523-a30b59c0b280 tempest-GroupSnapshotsV319Test-1604552887 None] Lock "cinder-quobyte-9efe2c8d-1fe0-4460-9882-1e3fd20e34fd" released by "delete_volume" :: held 1.552s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:57:09 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-743a6c3e-4f52-4825-8523-a30b59c0b280 tempest-GroupSnapshotsV319Test-1604552887 None] Created reservations ['d29a4886-b14b-401a-88cc-24296e590da2'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:57:09 devstack cinder-volume[93708]: WARNING cinder.quota [None req-743a6c3e-4f52-4825-8523-a30b59c0b280 tempest-GroupSnapshotsV319Test-1604552887 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1464425850 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1464425850, it is now deprecated. Please use the default quota class for default quota.
Jun 26 05:57:09 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-743a6c3e-4f52-4825-8523-a30b59c0b280 tempest-GroupSnapshotsV319Test-1604552887 None] Created reservations ['c491583c-bf24-40f3-ab83-93709c12ff30', '02f1198a-0495-4070-aa7a-ed03ffcddd45', '71ecc5ed-9255-4852-a47f-4fa9e4872892', 'c72c71db-80ed-491b-abe2-e59242f60bb8'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:57:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-743a6c3e-4f52-4825-8523-a30b59c0b280 tempest-GroupSnapshotsV319Test-1604552887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:57:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-743a6c3e-4f52-4825-8523-a30b59c0b280 tempest-GroupSnapshotsV319Test-1604552887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:57:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-743a6c3e-4f52-4825-8523-a30b59c0b280 tempest-GroupSnapshotsV319Test-1604552887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:57:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-743a6c3e-4f52-4825-8523-a30b59c0b280 tempest-GroupSnapshotsV319Test-1604552887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:57:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-743a6c3e-4f52-4825-8523-a30b59c0b280 tempest-GroupSnapshotsV319Test-1604552887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:57:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-743a6c3e-4f52-4825-8523-a30b59c0b280 tempest-GroupSnapshotsV319Test-1604552887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:09 devstack sudo[109543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:57:09 devstack sudo[109543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:10 devstack sudo[109543]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-743a6c3e-4f52-4825-8523-a30b59c0b280 tempest-GroupSnapshotsV319Test-1604552887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.754s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:10 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-743a6c3e-4f52-4825-8523-a30b59c0b280 tempest-GroupSnapshotsV319Test-1604552887 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:57:10 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-743a6c3e-4f52-4825-8523-a30b59c0b280 tempest-GroupSnapshotsV319Test-1604552887 None] Delete group completed successfully.
Jun 26 05:57:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:57:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:57:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:57:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:57:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:57:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:57:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:10 devstack sudo[109546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:57:10 devstack sudo[109546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:11 devstack sudo[109546]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.855s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:11 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:57:11 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:57:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 28 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:57:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>, <Thread(tpool_thread_0, started daemon 124035494721216)>, <Thread(tpool_thread_1, started daemon 124035486328512)>, <Thread(tpool_thread_2, started daemon 124035477919424)>, <Thread(tpool_thread_3, started daemon 124035469510336)>, <Thread(tpool_thread_4, started daemon 124035461101248)>, <Thread(tpool_thread_5, started daemon 124035452692160)>, <Thread(tpool_thread_6, started daemon 124035444283072)>, <Thread(tpool_thread_7, started daemon 124035435873984)>, <Thread(tpool_thread_8, started daemon 124035427464896)>, <Thread(tpool_thread_9, started daemon 124035419055808)>, <Thread(tpool_thread_10, started daemon 124035410646720)>, <Thread(tpool_thread_11, started daemon 124035402237632)>, <Thread(tpool_thread_12, started daemon 124035393828544)>, <Thread(tpool_thread_13, started daemon 124035385419456)>, <Thread(tpool_thread_14, started daemon 124035377010368)>, <Thread(tpool_thread_15, started daemon 124035368601280)>, <Thread(tpool_thread_16, started daemon 124035360192192)>, <Thread(tpool_thread_17, started daemon 124035351783104)>, <Thread(tpool_thread_18, started daemon 124035343374016)>, <Thread(tpool_thread_19, started daemon 124035334964928)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:57:19 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:DELETE=3,cinder:SELECT=31,cinder:UPDATE=40,cinder:INSERT=11 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:57:19 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=43,cinder:UPDATE=39,cinder:INSERT=8 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Flow 'volume_create_manager' (01edba58-0ffc-41a9-8344-217fd3471f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a250ae-795e-4348-9e40-4d62a462d290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a250ae-795e-4348-9e40-4d62a462d290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1829299702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8449cdc8-7b9d-4fec-be6f-05e7c8543ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51358e55ec754333a10e01ab84b79a96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:57:24Z,use_quota=True,user_id='accf5c74ad3848a0b53a7b61bd5ae5ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e385a1f-f231-4c72-9618-2bc0ed6af35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e385a1f-f231-4c72-9618-2bc0ed6af35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac71b3f9-3601-43f0-ad9b-7e8dc2d27702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac71b3f9-3601-43f0-ad9b-7e8dc2d27702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8449cdc8-7b9d-4fec-be6f-05e7c8543ebc', 'volume_name': 'volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70948a66-48ce-454d-8fce-5ebf04927eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70948a66-48ce-454d-8fce-5ebf04927eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f46d1901-8fc5-4157-af0d-956f6e382bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:57:23 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Volume 8449cdc8-7b9d-4fec-be6f-05e7c8543ebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc', 'volume_size': 1}
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1829299702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8449cdc8-7b9d-4fec-be6f-05e7c8543ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51358e55ec754333a10e01ab84b79a96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:57:24Z,use_quota=True,user_id='accf5c74ad3848a0b53a7b61bd5ae5ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Creating volume 8449cdc8-7b9d-4fec-be6f-05e7c8543ebc {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:57:23 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:57:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:23 devstack sudo[109553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc 1073741824
Jun 26 05:57:23 devstack sudo[109553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:24 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:57:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Flow 'volume_create_manager' (62403dca-702e-40b1-be5c-83a92d45d2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:57:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30476dc7-7086-4f17-b0ca-15ada0abc932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:57:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30476dc7-7086-4f17-b0ca-15ada0abc932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-841387583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d83807-c2ae-4d90-8cb3-8479f15296a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8e425fb33e4513a388ec4052b69952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:57:24Z,use_quota=True,user_id='90ee24de849d4cd6bd082742693a6a3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:57:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6626352-6835-43cd-a997-637631572056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:57:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6626352-6835-43cd-a997-637631572056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:57:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf18f150-af4c-4c5d-b15b-2f7d642fbfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:57:24 devstack cinder-volume[93708]: DEBUG cinder.image.glance [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Creating Keystone auth plugin from conf {{(pid=93708) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 26 05:57:24 devstack sudo[109553]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc 1073741824" returned: 0 in 0.864s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:24 devstack sudo[109559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc
Jun 26 05:57:24 devstack sudo[109559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf18f150-af4c-4c5d-b15b-2f7d642fbfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '83d83807-c2ae-4d90-8cb3-8479f15296a1', 'volume_name': 'volume-83d83807-c2ae-4d90-8cb3-8479f15296a1', 'volume_size': 1, 'image_id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '672660d1b01a45828d72fce38b12f1f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'created_at': datetime.datetime(2026, 6, 26, 3, 35, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 3, 35, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfc393ae-7412-4258-bda5-dc0a6732fb07/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf43dc85f0>}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:57:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cc510f-5783-483a-8483-6bf3850847a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:57:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cc510f-5783-483a-8483-6bf3850847a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:57:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073a7936-e553-4d92-92cb-ed7df29145b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:57:24 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Volume 83d83807-c2ae-4d90-8cb3-8479f15296a1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-83d83807-c2ae-4d90-8cb3-8479f15296a1', 'volume_size': 1, 'image_id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '672660d1b01a45828d72fce38b12f1f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'created_at': datetime.datetime(2026, 6, 26, 3, 35, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 3, 35, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfc393ae-7412-4258-bda5-dc0a6732fb07/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf43dc85f0>}
Jun 26 05:57:24 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Trying to clone 83d83807-c2ae-4d90-8cb3-8479f15296a1 from image dfc393ae-7412-4258-bda5-dc0a6732fb07 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}]). {{(pid=93708) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 26 05:57:25 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_esebkgs8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 26 05:57:25 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Image download 20.69 MB at 20.69 MB/s
Jun 26 05:57:25 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7045521-083f-446b-b988-36434380cc2c]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:57:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_esebkgs8devstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:25 devstack sudo[109562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_esebkgs8devstack@QuobyteHD
Jun 26 05:57:25 devstack sudo[109562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:25 devstack sudo[109559]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" returned: 0 in 0.680s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:25 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:57:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:57:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f46d1901-8fc5-4157-af0d-956f6e382bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:57:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63398da3-64bc-46ed-a878-241d20216c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:57:25 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Volume volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc (8449cdc8-7b9d-4fec-be6f-05e7c8543ebc): created successfully
Jun 26 05:57:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63398da3-64bc-46ed-a878-241d20216c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:57:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Flow 'volume_create_manager' (01edba58-0ffc-41a9-8344-217fd3471f39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:57:25 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-728c1c85-37f9-4824-a9f0-19bd9cd5e471 tempest-SnapshotsActionsTest-884453636 None] Created volume successfully.
Jun 26 05:57:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2f4e796e-f961-48f9-b4b9-d294b3376fcc tempest-SnapshotsActionsTest-884453636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:57:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2f4e796e-f961-48f9-b4b9-d294b3376fcc tempest-SnapshotsActionsTest-884453636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:57:25 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-2f4e796e-f961-48f9-b4b9-d294b3376fcc tempest-SnapshotsActionsTest-884453636 None] Creating offline snapshot b5b40e3d-daf4-4542-abf0-1abfeaa60e99 of volume 8449cdc8-7b9d-4fec-be6f-05e7c8543ebc {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:57:25 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[46955939-89c5-4c07-a393-725e29f62675]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:57:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f4e796e-f961-48f9-b4b9-d294b3376fcc tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:25 devstack sudo[109562]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_esebkgs8devstack@QuobyteHD" returned: 0 in 0.773s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:25 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Temporary image dfc393ae-7412-4258-bda5-dc0a6732fb07 is fetched for user 90ee24de849d4cd6bd082742693a6a3f. {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 26 05:57:26 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a57a673-1329-4825-954b-d1a72ff18d90]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:57:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_esebkgs8devstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:26 devstack sudo[109569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc
Jun 26 05:57:26 devstack sudo[109569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:26 devstack sudo[109570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_esebkgs8devstack@QuobyteHD
Jun 26 05:57:26 devstack sudo[109570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:26 devstack sudo[109569]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f4e796e-f961-48f9-b4b9-d294b3376fcc tempest-SnapshotsActionsTest-884453636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" returned: 0 in 0.795s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f4e796e-f961-48f9-b4b9-d294b3376fcc tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:26 devstack sudo[109581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 1G
Jun 26 05:57:26 devstack sudo[109581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:26 devstack sudo[109570]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_esebkgs8devstack@QuobyteHD" returned: 0 in 0.766s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:57:27 devstack sudo[109581]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f4e796e-f961-48f9-b4b9-d294b3376fcc tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 1G" returned: 0 in 0.786s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f4e796e-f961-48f9-b4b9-d294b3376fcc tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:27 devstack sudo[109586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99
Jun 26 05:57:27 devstack sudo[109586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:28 devstack sudo[109586]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f4e796e-f961-48f9-b4b9-d294b3376fcc tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99" returned: 0 in 0.669s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:28 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-2f4e796e-f961-48f9-b4b9-d294b3376fcc tempest-SnapshotsActionsTest-884453636 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 is being set with open permissions: ugo+rw
Jun 26 05:57:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f4e796e-f961-48f9-b4b9-d294b3376fcc tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:28 devstack sudo[109591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99
Jun 26 05:57:28 devstack sudo[109591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:28 devstack sudo[109591]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f4e796e-f961-48f9-b4b9-d294b3376fcc tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99" returned: 0 in 0.649s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f4e796e-f961-48f9-b4b9-d294b3376fcc tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:28 devstack sudo[109594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.info
Jun 26 05:57:28 devstack sudo[109594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:29 devstack sudo[109594]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f4e796e-f961-48f9-b4b9-d294b3376fcc tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.info" returned: 0 in 0.633s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:29 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-2f4e796e-f961-48f9-b4b9-d294b3376fcc tempest-SnapshotsActionsTest-884453636 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.info is being set with open permissions: ugo+rw
Jun 26 05:57:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f4e796e-f961-48f9-b4b9-d294b3376fcc tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:29 devstack sudo[109597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.info
Jun 26 05:57:29 devstack sudo[109597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:30 devstack sudo[109597]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-2f4e796e-f961-48f9-b4b9-d294b3376fcc tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.info" returned: 0 in 0.672s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-2f4e796e-f961-48f9-b4b9-d294b3376fcc tempest-SnapshotsActionsTest-884453636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.287s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:57:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.412s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:57:30 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-841387583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d83807-c2ae-4d90-8cb3-8479f15296a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8e425fb33e4513a388ec4052b69952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:57:24Z,use_quota=True,user_id='90ee24de849d4cd6bd082742693a6a3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:57:30 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Creating volume 83d83807-c2ae-4d90-8cb3-8479f15296a1 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:57:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:57:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:57:30 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:57:30 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:57:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:57:30 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:57:30 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:57:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:30 devstack sudo[109636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1 1073741824
Jun 26 05:57:30 devstack sudo[109636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:30 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-2f4e796e-f961-48f9-b4b9-d294b3376fcc tempest-SnapshotsActionsTest-884453636 None] Create snapshot completed successfully
Jun 26 05:57:31 devstack sudo[109636]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1 1073741824" returned: 0 in 0.792s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:31 devstack sudo[109641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1
Jun 26 05:57:31 devstack sudo[109641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-022eb414-ed6c-4be7-8dd4-e9cdce2311e1 tempest-SnapshotsActionsTest-884453636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:57:31 devstack sudo[109641]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1" returned: 0 in 0.676s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:57:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:57:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-022eb414-ed6c-4be7-8dd4-e9cdce2311e1 tempest-SnapshotsActionsTest-884453636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.142s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:57:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-022eb414-ed6c-4be7-8dd4-e9cdce2311e1 tempest-SnapshotsActionsTest-884453636 None] Creating offline snapshot ff6f461c-374e-484c-b34f-2add1c6e1a24 of volume 8449cdc8-7b9d-4fec-be6f-05e7c8543ebc {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:57:31 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[57997207-c141-40b7-810c-5d8e3f0e67c4]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:57:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-022eb414-ed6c-4be7-8dd4-e9cdce2311e1 tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:31 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Attempting download of dfc393ae-7412-4258-bda5-dc0a6732fb07 ((None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}])) to volume 83d83807-c2ae-4d90-8cb3-8479f15296a1. {{(pid=93708) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 26 05:57:31 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfed6ec-2b65-4ff4-906a-bcab64ba379b]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:57:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_cpqskvqj {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:31 devstack sudo[109644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99
Jun 26 05:57:31 devstack sudo[109644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:31 devstack sudo[109645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_cpqskvqj
Jun 26 05:57:31 devstack sudo[109645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:32 devstack sudo[109644]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-022eb414-ed6c-4be7-8dd4-e9cdce2311e1 tempest-SnapshotsActionsTest-884453636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99" returned: 0 in 0.743s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:32 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-022eb414-ed6c-4be7-8dd4-e9cdce2311e1 tempest-SnapshotsActionsTest-884453636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:57:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-022eb414-ed6c-4be7-8dd4-e9cdce2311e1 tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.ff6f461c-374e-484c-b34f-2add1c6e1a24 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:32 devstack sudo[109654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.ff6f461c-374e-484c-b34f-2add1c6e1a24 1G
Jun 26 05:57:32 devstack sudo[109654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:32 devstack sudo[109645]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_cpqskvqj" returned: 0 in 0.784s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_cpqskvqj {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:32 devstack sudo[109656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_cpqskvqj
Jun 26 05:57:32 devstack sudo[109656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:33 devstack sudo[109654]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-022eb414-ed6c-4be7-8dd4-e9cdce2311e1 tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.ff6f461c-374e-484c-b34f-2add1c6e1a24 1G" returned: 0 in 0.862s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-022eb414-ed6c-4be7-8dd4-e9cdce2311e1 tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.ff6f461c-374e-484c-b34f-2add1c6e1a24 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:33 devstack sudo[109663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.ff6f461c-374e-484c-b34f-2add1c6e1a24
Jun 26 05:57:33 devstack sudo[109663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:33 devstack sudo[109656]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_cpqskvqj" returned: 1 in 0.796s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfc393ae-7412-4258-bda5-dc0a6732fb07_cpqskvqj' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 05:57:33 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf80dd1-fc78-47cf-b8cb-09f354c08086]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:57:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_esebkgs8devstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:33 devstack sudo[109665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_esebkgs8devstack@QuobyteHD
Jun 26 05:57:33 devstack sudo[109665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:34 devstack sudo[109663]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-022eb414-ed6c-4be7-8dd4-e9cdce2311e1 tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.ff6f461c-374e-484c-b34f-2add1c6e1a24" returned: 0 in 0.669s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:34 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-022eb414-ed6c-4be7-8dd4-e9cdce2311e1 tempest-SnapshotsActionsTest-884453636 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.ff6f461c-374e-484c-b34f-2add1c6e1a24 is being set with open permissions: ugo+rw
Jun 26 05:57:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-022eb414-ed6c-4be7-8dd4-e9cdce2311e1 tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.ff6f461c-374e-484c-b34f-2add1c6e1a24 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:34 devstack sudo[109670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.ff6f461c-374e-484c-b34f-2add1c6e1a24
Jun 26 05:57:34 devstack sudo[109670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:34 devstack sudo[109665]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_esebkgs8devstack@QuobyteHD" returned: 0 in 0.770s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:34 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] dfc393ae-7412-4258-bda5-dc0a6732fb07 was qcow2, converting to raw {{(pid=93708) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 26 05:57:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_esebkgs8devstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:34 devstack sudo[109675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_esebkgs8devstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1
Jun 26 05:57:34 devstack sudo[109675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:34 devstack sudo[109670]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-022eb414-ed6c-4be7-8dd4-e9cdce2311e1 tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.ff6f461c-374e-484c-b34f-2add1c6e1a24" returned: 0 in 0.674s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-022eb414-ed6c-4be7-8dd4-e9cdce2311e1 tempest-SnapshotsActionsTest-884453636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.046s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:57:34 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-022eb414-ed6c-4be7-8dd4-e9cdce2311e1 tempest-SnapshotsActionsTest-884453636 None] Create snapshot completed successfully
Jun 26 05:57:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] Acquiring lock "cinder-ff6f461c-374e-484c-b34f-2add1c6e1a24-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:57:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-ff6f461c-374e-484c-b34f-2add1c6e1a24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:57:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] Acquiring lock "cinder-quobyte-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:57:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-quobyte-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:57:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] Acquiring lock "cinder-quobyte-ff6f461c-374e-484c-b34f-2add1c6e1a24" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:57:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-quobyte-ff6f461c-374e-484c-b34f-2add1c6e1a24" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:57:35 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] Deleting offline snapshot ff6f461c-374e-484c-b34f-2add1c6e1a24 of volume 8449cdc8-7b9d-4fec-be6f-05e7c8543ebc {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:57:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] snapshot_file for this snap is: volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.ff6f461c-374e-484c-b34f-2add1c6e1a24 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:57:36 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8760144-be37-4c49-b127-ccd05e461606]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:57:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.ff6f461c-374e-484c-b34f-2add1c6e1a24 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:36 devstack sudo[109675]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_esebkgs8devstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1" returned: 0 in 1.865s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:36 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dfc393ae-7412-4258-bda5-dc0a6732fb07_esebkgs8devstack@QuobyteHD, size 112.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1 {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 05:57:36 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Converted 112.00 MB image at 60.03 MB/s
Jun 26 05:57:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:36 devstack sudo[109689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.ff6f461c-374e-484c-b34f-2add1c6e1a24
Jun 26 05:57:36 devstack sudo[109689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:36 devstack sudo[109690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1 1G
Jun 26 05:57:36 devstack sudo[109690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:36 devstack sudo[109690]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1 1G" returned: 0 in 0.683s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:36 devstack sudo[109689]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.ff6f461c-374e-484c-b34f-2add1c6e1a24" returned: 0 in 0.788s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:57:36 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[207764f5-1ee9-4996-a16e-089938d2360c]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:57:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:36 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5c134c-b234-4386-a1b0-f23a8a32bcf7]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:57:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:36 devstack sudo[109699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1
Jun 26 05:57:36 devstack sudo[109699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:36 devstack sudo[109700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99
Jun 26 05:57:36 devstack sudo[109700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:37 devstack sudo[109699]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:37 devstack sudo[109700]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1" returned: 0 in 0.773s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99" returned: 0 in 0.772s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:37 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:57:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.ff6f461c-374e-484c-b34f-2add1c6e1a24 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:37 devstack sudo[109710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.ff6f461c-374e-484c-b34f-2add1c6e1a24
Jun 26 05:57:37 devstack sudo[109710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:37 devstack sudo[109709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1
Jun 26 05:57:37 devstack sudo[109709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:38 devstack sudo[109709]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1" returned: 1 in 0.756s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 05:57:38 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Downloaded image dfc393ae-7412-4258-bda5-dc0a6732fb07 ((None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}])) to volume 83d83807-c2ae-4d90-8cb3-8479f15296a1 successfully. {{(pid=93708) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 26 05:57:38 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Temporary image dfc393ae-7412-4258-bda5-dc0a6732fb07 for user 90ee24de849d4cd6bd082742693a6a3f is deleted. {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 26 05:57:38 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Marking volume 83d83807-c2ae-4d90-8cb3-8479f15296a1 as bootable. {{(pid=93708) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 26 05:57:38 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Copying metadata from image dfc393ae-7412-4258-bda5-dc0a6732fb07 to 83d83807-c2ae-4d90-8cb3-8479f15296a1. {{(pid=93708) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 26 05:57:38 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Creating volume glance metadata for volume 83d83807-c2ae-4d90-8cb3-8479f15296a1 backed by image dfc393ae-7412-4258-bda5-dc0a6732fb07 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93708) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 26 05:57:38 devstack sudo[109710]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.ff6f461c-374e-484c-b34f-2add1c6e1a24" returned: 0 in 0.773s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.ff6f461c-374e-484c-b34f-2add1c6e1a24 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:38 devstack sudo[109720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.ff6f461c-374e-484c-b34f-2add1c6e1a24
Jun 26 05:57:38 devstack sudo[109720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073a7936-e553-4d92-92cb-ed7df29145b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83d83807-c2ae-4d90-8cb3-8479f15296a1', 'volume_size': 1, 'image_id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfc393ae-7412-4258-bda5-dc0a6732fb07', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '672660d1b01a45828d72fce38b12f1f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dfc393ae-7412-4258-bda5-dc0a6732fb07', 'created_at': datetime.datetime(2026, 6, 26, 3, 35, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 3, 35, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfc393ae-7412-4258-bda5-dc0a6732fb07/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf43dc85f0>}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:57:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9971b7d0-6ee8-4bf2-852c-3fac6e2ac4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:57:38 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Volume volume-83d83807-c2ae-4d90-8cb3-8479f15296a1 (83d83807-c2ae-4d90-8cb3-8479f15296a1): created successfully
Jun 26 05:57:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9971b7d0-6ee8-4bf2-852c-3fac6e2ac4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:57:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Flow 'volume_create_manager' (62403dca-702e-40b1-be5c-83a92d45d2b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:57:38 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-c8520dd3-6d71-4dea-9e0c-b8d356dbf068 tempest-TestShelveInstance-1456519661 None] Created volume successfully.
Jun 26 05:57:39 devstack sudo[109720]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.ff6f461c-374e-484c-b34f-2add1c6e1a24" returned: 0 in 0.659s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-quobyte-ff6f461c-374e-484c-b34f-2add1c6e1a24" released by "_delete_snapshot" :: held 3.105s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:57:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-quobyte-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" released by "delete_snapshot" :: held 3.135s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:57:39 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] Created reservations ['5396063a-ce45-4ea0-ab00-ecd45c421ab7', '6843a1ce-09a4-41f6-aec6-3635e574d74b', '513ffbc0-7bd7-49a2-ae81-dc8a2fda4b92', '765cf275-3d9e-46b4-be53-c38d40b2a284'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:57:39 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] Delete snapshot completed successfully.
Jun 26 05:57:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-493bd1c1-24cf-4018-9d30-e01818978033 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-ff6f461c-374e-484c-b34f-2add1c6e1a24-delete_snapshot" released by "delete_snapshot" :: held 3.291s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:57:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9656ff81-e231-4008-bd02-61490bf8a1c5 tempest-SnapshotsActionsTest-884453636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:57:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9656ff81-e231-4008-bd02-61490bf8a1c5 tempest-SnapshotsActionsTest-884453636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:57:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-9656ff81-e231-4008-bd02-61490bf8a1c5 tempest-SnapshotsActionsTest-884453636 None] Creating offline snapshot a19f5415-601b-4db3-90ed-32243afc275f of volume 8449cdc8-7b9d-4fec-be6f-05e7c8543ebc {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:57:40 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ae4bf2-e661-4c5a-bab7-fc02663c9e3d]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:57:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9656ff81-e231-4008-bd02-61490bf8a1c5 tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:40 devstack sudo[109726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99
Jun 26 05:57:40 devstack sudo[109726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:41 devstack sudo[109726]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9656ff81-e231-4008-bd02-61490bf8a1c5 tempest-SnapshotsActionsTest-884453636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99" returned: 0 in 0.806s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-9656ff81-e231-4008-bd02-61490bf8a1c5 tempest-SnapshotsActionsTest-884453636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:57:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9656ff81-e231-4008-bd02-61490bf8a1c5 tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.a19f5415-601b-4db3-90ed-32243afc275f 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:41 devstack sudo[109731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.a19f5415-601b-4db3-90ed-32243afc275f 1G
Jun 26 05:57:41 devstack sudo[109731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:42 devstack sudo[109731]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9656ff81-e231-4008-bd02-61490bf8a1c5 tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.a19f5415-601b-4db3-90ed-32243afc275f 1G" returned: 0 in 0.816s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9656ff81-e231-4008-bd02-61490bf8a1c5 tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.a19f5415-601b-4db3-90ed-32243afc275f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:42 devstack sudo[109737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.a19f5415-601b-4db3-90ed-32243afc275f
Jun 26 05:57:42 devstack sudo[109737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:42 devstack sudo[109737]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9656ff81-e231-4008-bd02-61490bf8a1c5 tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.a19f5415-601b-4db3-90ed-32243afc275f" returned: 0 in 0.691s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:42 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-9656ff81-e231-4008-bd02-61490bf8a1c5 tempest-SnapshotsActionsTest-884453636 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.a19f5415-601b-4db3-90ed-32243afc275f is being set with open permissions: ugo+rw
Jun 26 05:57:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9656ff81-e231-4008-bd02-61490bf8a1c5 tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.a19f5415-601b-4db3-90ed-32243afc275f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:42 devstack sudo[109742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.a19f5415-601b-4db3-90ed-32243afc275f
Jun 26 05:57:42 devstack sudo[109742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:43 devstack sudo[109742]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9656ff81-e231-4008-bd02-61490bf8a1c5 tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.a19f5415-601b-4db3-90ed-32243afc275f" returned: 0 in 0.631s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9656ff81-e231-4008-bd02-61490bf8a1c5 tempest-SnapshotsActionsTest-884453636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.045s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:57:43 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-9656ff81-e231-4008-bd02-61490bf8a1c5 tempest-SnapshotsActionsTest-884453636 None] Create snapshot completed successfully
Jun 26 05:57:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] Acquiring lock "cinder-a19f5415-601b-4db3-90ed-32243afc275f-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:57:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-a19f5415-601b-4db3-90ed-32243afc275f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:57:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] Acquiring lock "cinder-quobyte-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:57:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-quobyte-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:57:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] Acquiring lock "cinder-quobyte-a19f5415-601b-4db3-90ed-32243afc275f" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:57:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-quobyte-a19f5415-601b-4db3-90ed-32243afc275f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:57:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] Deleting offline snapshot a19f5415-601b-4db3-90ed-32243afc275f of volume 8449cdc8-7b9d-4fec-be6f-05e7c8543ebc {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:57:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] snapshot_file for this snap is: volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.a19f5415-601b-4db3-90ed-32243afc275f {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:57:44 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c90020-3184-4ab9-98c2-d13c06c4ed34]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:57:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.a19f5415-601b-4db3-90ed-32243afc275f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:44 devstack sudo[109745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.a19f5415-601b-4db3-90ed-32243afc275f
Jun 26 05:57:44 devstack sudo[109745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:45 devstack sudo[109745]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.a19f5415-601b-4db3-90ed-32243afc275f" returned: 0 in 0.867s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:57:45 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6a4153-b1bf-429a-bdf1-f5dce11bde27]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:57:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:45 devstack sudo[109750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99
Jun 26 05:57:45 devstack sudo[109750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-b6a06c1f-a38a-42d7-9255-b87a69305e97 req-ad77eda7-b819-41ea-8e1c-ffca2d7bbb2e tempest-TestShelveInstance-1456519661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:57:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-b6a06c1f-a38a-42d7-9255-b87a69305e97 req-ad77eda7-b819-41ea-8e1c-ffca2d7bbb2e tempest-TestShelveInstance-1456519661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:57:46 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5497ea3-8bf4-4224-9112-b9d953692374]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:57:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-b6a06c1f-a38a-42d7-9255-b87a69305e97 req-ad77eda7-b819-41ea-8e1c-ffca2d7bbb2e tempest-TestShelveInstance-1456519661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:46 devstack sudo[109760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1
Jun 26 05:57:46 devstack sudo[109760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:46 devstack sudo[109750]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99" returned: 0 in 0.881s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:46 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:57:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.a19f5415-601b-4db3-90ed-32243afc275f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:46 devstack sudo[109766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.a19f5415-601b-4db3-90ed-32243afc275f
Jun 26 05:57:46 devstack sudo[109766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:47 devstack sudo[109760]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-b6a06c1f-a38a-42d7-9255-b87a69305e97 req-ad77eda7-b819-41ea-8e1c-ffca2d7bbb2e tempest-TestShelveInstance-1456519661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1" returned: 0 in 0.881s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-b6a06c1f-a38a-42d7-9255-b87a69305e97 req-ad77eda7-b819-41ea-8e1c-ffca2d7bbb2e tempest-TestShelveInstance-1456519661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:47 devstack sudo[109770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1
Jun 26 05:57:47 devstack sudo[109770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:47 devstack sudo[109766]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.a19f5415-601b-4db3-90ed-32243afc275f" returned: 0 in 0.819s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.a19f5415-601b-4db3-90ed-32243afc275f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:47 devstack sudo[109775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.a19f5415-601b-4db3-90ed-32243afc275f
Jun 26 05:57:47 devstack sudo[109775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:47 devstack sudo[109770]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-b6a06c1f-a38a-42d7-9255-b87a69305e97 req-ad77eda7-b819-41ea-8e1c-ffca2d7bbb2e tempest-TestShelveInstance-1456519661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1" returned: 1 in 0.798s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-b6a06c1f-a38a-42d7-9255-b87a69305e97 req-ad77eda7-b819-41ea-8e1c-ffca2d7bbb2e tempest-TestShelveInstance-1456519661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 05:57:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-b6a06c1f-a38a-42d7-9255-b87a69305e97 req-ad77eda7-b819-41ea-8e1c-ffca2d7bbb2e tempest-TestShelveInstance-1456519661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.721s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:57:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-b6a06c1f-a38a-42d7-9255-b87a69305e97 req-ad77eda7-b819-41ea-8e1c-ffca2d7bbb2e tempest-TestShelveInstance-1456519661 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85', 'name': 'volume-83d83807-c2ae-4d90-8cb3-8479f15296a1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41ae0741-6cc4-4865-bb5b-4a97995cd1ad', 'enforce_multipath': True} {{(pid=93708) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 05:57:47 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-b6a06c1f-a38a-42d7-9255-b87a69305e97 req-ad77eda7-b819-41ea-8e1c-ffca2d7bbb2e tempest-TestShelveInstance-1456519661 None] attachment_update completed successfully.
Jun 26 05:57:48 devstack sudo[109775]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.a19f5415-601b-4db3-90ed-32243afc275f" returned: 0 in 0.679s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:48 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-quobyte-a19f5415-601b-4db3-90ed-32243afc275f" released by "_delete_snapshot" :: held 3.366s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:57:48 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-quobyte-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" released by "delete_snapshot" :: held 3.392s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:57:48 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] Created reservations ['a57abd53-4837-4ace-8f01-b163d0d8ce64', '11a74dc4-a4f4-4574-befd-b5dac4adc026', '16584e10-ba48-4b83-8337-18e0ab6f4ab5', '3031ec87-738b-4be9-9e53-fcc659037ed1'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:57:48 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] Delete snapshot completed successfully.
Jun 26 05:57:48 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-12cd26ae-f6a3-4acd-8da9-8190c145afa4 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-a19f5415-601b-4db3-90ed-32243afc275f-delete_snapshot" released by "delete_snapshot" :: held 3.556s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:57:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dc844fe6-c84c-410c-993d-45ec09caa494 tempest-SnapshotsActionsTest-884453636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:57:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dc844fe6-c84c-410c-993d-45ec09caa494 tempest-SnapshotsActionsTest-884453636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:57:49 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-dc844fe6-c84c-410c-993d-45ec09caa494 tempest-SnapshotsActionsTest-884453636 None] Creating offline snapshot b205173a-144b-44c0-976e-ef25dd9d8d55 of volume 8449cdc8-7b9d-4fec-be6f-05e7c8543ebc {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:57:49 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf01fc7-fbf3-40d9-89d4-1c5c965f4d5c]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:57:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dc844fe6-c84c-410c-993d-45ec09caa494 tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:49 devstack sudo[109781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99
Jun 26 05:57:49 devstack sudo[109781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:50 devstack sudo[109781]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dc844fe6-c84c-410c-993d-45ec09caa494 tempest-SnapshotsActionsTest-884453636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99" returned: 0 in 0.797s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:50 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-dc844fe6-c84c-410c-993d-45ec09caa494 tempest-SnapshotsActionsTest-884453636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:57:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dc844fe6-c84c-410c-993d-45ec09caa494 tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b205173a-144b-44c0-976e-ef25dd9d8d55 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:50 devstack sudo[109853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b205173a-144b-44c0-976e-ef25dd9d8d55 1G
Jun 26 05:57:50 devstack sudo[109853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:51 devstack sudo[109853]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dc844fe6-c84c-410c-993d-45ec09caa494 tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b205173a-144b-44c0-976e-ef25dd9d8d55 1G" returned: 0 in 0.829s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dc844fe6-c84c-410c-993d-45ec09caa494 tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b205173a-144b-44c0-976e-ef25dd9d8d55 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:51 devstack sudo[109858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b205173a-144b-44c0-976e-ef25dd9d8d55
Jun 26 05:57:51 devstack sudo[109858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:51 devstack sudo[109858]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dc844fe6-c84c-410c-993d-45ec09caa494 tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b205173a-144b-44c0-976e-ef25dd9d8d55" returned: 0 in 0.699s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:51 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-dc844fe6-c84c-410c-993d-45ec09caa494 tempest-SnapshotsActionsTest-884453636 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b205173a-144b-44c0-976e-ef25dd9d8d55 is being set with open permissions: ugo+rw
Jun 26 05:57:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dc844fe6-c84c-410c-993d-45ec09caa494 tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b205173a-144b-44c0-976e-ef25dd9d8d55 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:51 devstack sudo[109866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b205173a-144b-44c0-976e-ef25dd9d8d55
Jun 26 05:57:51 devstack sudo[109866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:52 devstack sudo[109866]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-dc844fe6-c84c-410c-993d-45ec09caa494 tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b205173a-144b-44c0-976e-ef25dd9d8d55" returned: 0 in 0.653s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-dc844fe6-c84c-410c-993d-45ec09caa494 tempest-SnapshotsActionsTest-884453636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.092s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:57:52 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-dc844fe6-c84c-410c-993d-45ec09caa494 tempest-SnapshotsActionsTest-884453636 None] Create snapshot completed successfully
Jun 26 05:57:53 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] Acquiring lock "cinder-b205173a-144b-44c0-976e-ef25dd9d8d55-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:57:53 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-b205173a-144b-44c0-976e-ef25dd9d8d55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:57:53 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] Acquiring lock "cinder-quobyte-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:57:53 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-quobyte-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:57:53 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] Acquiring lock "cinder-quobyte-b205173a-144b-44c0-976e-ef25dd9d8d55" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:57:53 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-quobyte-b205173a-144b-44c0-976e-ef25dd9d8d55" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:57:53 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] Deleting offline snapshot b205173a-144b-44c0-976e-ef25dd9d8d55 of volume 8449cdc8-7b9d-4fec-be6f-05e7c8543ebc {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:57:53 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] snapshot_file for this snap is: volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b205173a-144b-44c0-976e-ef25dd9d8d55 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:57:53 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[d541ce02-6ea2-4bcb-ab0d-75d017ec97ec]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:57:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b205173a-144b-44c0-976e-ef25dd9d8d55 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:54 devstack sudo[110239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b205173a-144b-44c0-976e-ef25dd9d8d55
Jun 26 05:57:54 devstack sudo[110239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:54 devstack sudo[110239]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b205173a-144b-44c0-976e-ef25dd9d8d55" returned: 0 in 1.001s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:57:54 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2d75d5-4b40-4978-9032-54cd0d324a9c]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:57:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:54 devstack sudo[110265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99
Jun 26 05:57:54 devstack sudo[110265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:55 devstack sudo[110265]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99" returned: 0 in 0.855s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:55 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:57:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b205173a-144b-44c0-976e-ef25dd9d8d55 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:55 devstack sudo[110272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b205173a-144b-44c0-976e-ef25dd9d8d55
Jun 26 05:57:55 devstack sudo[110272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:56 devstack sudo[110272]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b205173a-144b-44c0-976e-ef25dd9d8d55" returned: 0 in 0.895s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b205173a-144b-44c0-976e-ef25dd9d8d55 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:56 devstack sudo[110277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b205173a-144b-44c0-976e-ef25dd9d8d55
Jun 26 05:57:56 devstack sudo[110277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:57 devstack sudo[110277]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b205173a-144b-44c0-976e-ef25dd9d8d55" returned: 0 in 0.780s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-quobyte-b205173a-144b-44c0-976e-ef25dd9d8d55" released by "_delete_snapshot" :: held 3.682s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:57:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-quobyte-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" released by "delete_snapshot" :: held 3.725s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:57:57 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] Created reservations ['7d05f2bb-08f9-4809-9f10-fad388d7c3ae', 'a8df8600-b8ef-4b9d-8da4-57a510b4d948', '214bc4dd-b284-4b75-878f-6faaf43d2682', '8db260dd-104e-4cf1-8b9f-d843a8861743'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:57:57 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] Delete snapshot completed successfully.
Jun 26 05:57:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9a60b866-d7ff-4159-a2fc-7c853ecded15 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-b205173a-144b-44c0-976e-ef25dd9d8d55-delete_snapshot" released by "delete_snapshot" :: held 3.913s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:57:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a32ae9c2-28c3-4c6a-99d0-11a107151561 tempest-SnapshotsActionsTest-884453636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:57:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a32ae9c2-28c3-4c6a-99d0-11a107151561 tempest-SnapshotsActionsTest-884453636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:57:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-a32ae9c2-28c3-4c6a-99d0-11a107151561 tempest-SnapshotsActionsTest-884453636 None] Creating offline snapshot 01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe of volume 8449cdc8-7b9d-4fec-be6f-05e7c8543ebc {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 05:57:58 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[181a386f-7f23-4417-8b6f-c59285bbcc2b]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:57:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a32ae9c2-28c3-4c6a-99d0-11a107151561 tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:58 devstack sudo[110280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99
Jun 26 05:57:58 devstack sudo[110280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:57:59 devstack sudo[110280]: pam_unix(sudo:session): session closed for user root
Jun 26 05:57:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a32ae9c2-28c3-4c6a-99d0-11a107151561 tempest-SnapshotsActionsTest-884453636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99" returned: 0 in 0.877s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:57:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-a32ae9c2-28c3-4c6a-99d0-11a107151561 tempest-SnapshotsActionsTest-884453636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:57:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a32ae9c2-28c3-4c6a-99d0-11a107151561 tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:57:59 devstack sudo[110287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe 1G
Jun 26 05:57:59 devstack sudo[110287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:00 devstack sudo[110287]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a32ae9c2-28c3-4c6a-99d0-11a107151561 tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe 1G" returned: 0 in 0.932s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a32ae9c2-28c3-4c6a-99d0-11a107151561 tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:58:00 devstack sudo[110294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe
Jun 26 05:58:00 devstack sudo[110294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:00 devstack sudo[110294]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a32ae9c2-28c3-4c6a-99d0-11a107151561 tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe" returned: 0 in 0.730s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:01 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-a32ae9c2-28c3-4c6a-99d0-11a107151561 tempest-SnapshotsActionsTest-884453636 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe is being set with open permissions: ugo+rw
Jun 26 05:58:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a32ae9c2-28c3-4c6a-99d0-11a107151561 tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:58:01 devstack sudo[110305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe
Jun 26 05:58:01 devstack sudo[110305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:01 devstack sudo[110305]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a32ae9c2-28c3-4c6a-99d0-11a107151561 tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe" returned: 0 in 0.662s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a32ae9c2-28c3-4c6a-99d0-11a107151561 tempest-SnapshotsActionsTest-884453636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.349s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:58:01 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-a32ae9c2-28c3-4c6a-99d0-11a107151561 tempest-SnapshotsActionsTest-884453636 None] Create snapshot completed successfully
Jun 26 05:58:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] Acquiring lock "cinder-01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:58:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:58:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] Acquiring lock "cinder-quobyte-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:58:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-quobyte-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:58:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] Acquiring lock "cinder-quobyte-01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:58:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-quobyte-01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:58:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] Deleting offline snapshot 01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe of volume 8449cdc8-7b9d-4fec-be6f-05e7c8543ebc {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:58:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] snapshot_file for this snap is: volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:58:02 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e18c710-42c5-41b3-9406-7d7c95d3c647]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:58:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:58:02 devstack sudo[110310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe
Jun 26 05:58:02 devstack sudo[110310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:03 devstack sudo[110310]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe" returned: 0 in 0.793s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:03 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:58:03 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a088eb-d32c-4938-963f-3e54170fbdef]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:58:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:58:03 devstack sudo[110316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99
Jun 26 05:58:03 devstack sudo[110316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:04 devstack sudo[110316]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99" returned: 0 in 0.778s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:04 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:58:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:58:04 devstack sudo[110323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe
Jun 26 05:58:04 devstack sudo[110323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:05 devstack sudo[110323]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe" returned: 0 in 0.833s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:58:05 devstack sudo[110329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe
Jun 26 05:58:05 devstack sudo[110329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:05 devstack sudo[110329]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe" returned: 0 in 0.688s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:05 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-quobyte-01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe" released by "_delete_snapshot" :: held 3.180s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:58:05 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-quobyte-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" released by "delete_snapshot" :: held 3.203s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:58:05 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] Created reservations ['56f3234c-d419-4e4d-827d-5df8817ab73f', 'c49d6354-0d14-48d1-806e-f499f3fc6707', '47272112-bc2f-4e56-b322-6440ea117351', '6c39d2f6-5984-46a7-816d-02e41a99fa2c'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:58:06 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] Delete snapshot completed successfully.
Jun 26 05:58:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-066044eb-1645-4216-a02b-c7da78ce82d1 tempest-SnapshotsActionsTest-2144591077 None] Lock "cinder-01bd6ae0-6ef5-46d6-9d33-fd1cd1dccbbe-delete_snapshot" released by "delete_snapshot" :: held 3.352s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:58:07 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] Acquiring lock "cinder-b5b40e3d-daf4-4542-abf0-1abfeaa60e99-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:58:07 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] Lock "cinder-b5b40e3d-daf4-4542-abf0-1abfeaa60e99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:58:07 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] Acquiring lock "cinder-quobyte-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:58:07 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] Lock "cinder-quobyte-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:58:07 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] Acquiring lock "cinder-quobyte-b5b40e3d-daf4-4542-abf0-1abfeaa60e99" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:58:07 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] Lock "cinder-quobyte-b5b40e3d-daf4-4542-abf0-1abfeaa60e99" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:58:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] Deleting offline snapshot b5b40e3d-daf4-4542-abf0-1abfeaa60e99 of volume 8449cdc8-7b9d-4fec-be6f-05e7c8543ebc {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 05:58:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] snapshot_file for this snap is: volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 05:58:07 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b6024b-985d-4bd5-a8f7-2a60f6851c08]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:58:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:58:07 devstack sudo[110332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99
Jun 26 05:58:07 devstack sudo[110332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:08 devstack sudo[110332]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99" returned: 0 in 0.785s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:08 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 05:58:08 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd0b923-7af5-49a5-a29f-85e4c59f6d17]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:58:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:58:08 devstack sudo[110337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc
Jun 26 05:58:08 devstack sudo[110337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:08 devstack sudo[110337]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" returned: 0 in 0.790s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:58:09 devstack sudo[110345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99
Jun 26 05:58:09 devstack sudo[110345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:09 devstack sudo[110345]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99" returned: 0 in 0.894s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:58:09 devstack sudo[110404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99
Jun 26 05:58:09 devstack sudo[110404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:10 devstack sudo[110404]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc.b5b40e3d-daf4-4542-abf0-1abfeaa60e99" returned: 0 in 0.697s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:10 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] Lock "cinder-quobyte-b5b40e3d-daf4-4542-abf0-1abfeaa60e99" released by "_delete_snapshot" :: held 3.268s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:58:10 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] Lock "cinder-quobyte-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" released by "delete_snapshot" :: held 3.288s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:58:10 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] Created reservations ['21dd14e8-d058-4f82-8955-be241439bc59', 'dc8ae4ff-88a5-403a-bd9e-0551a282b6cc', '5907605c-8713-472b-b3b3-3f9365fde422', '9c70a546-9154-4bc5-ad24-77fad734e1ed'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:58:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:58:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:58:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:58:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:58:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:58:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:58:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:58:10 devstack sudo[110431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:58:10 devstack sudo[110431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:10 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] Delete snapshot completed successfully.
Jun 26 05:58:10 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-55c15262-4ee7-4c45-b07d-e1fa35391f5d tempest-SnapshotsActionsTest-884453636 None] Lock "cinder-b5b40e3d-daf4-4542-abf0-1abfeaa60e99-delete_snapshot" released by "delete_snapshot" :: held 3.445s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:58:11 devstack sudo[110431]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.641s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:11 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:58:11 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:58:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 28 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:58:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>, <Thread(tpool_thread_0, started daemon 124035494721216)>, <Thread(tpool_thread_1, started daemon 124035486328512)>, <Thread(tpool_thread_2, started daemon 124035477919424)>, <Thread(tpool_thread_3, started daemon 124035469510336)>, <Thread(tpool_thread_4, started daemon 124035461101248)>, <Thread(tpool_thread_5, started daemon 124035452692160)>, <Thread(tpool_thread_6, started daemon 124035444283072)>, <Thread(tpool_thread_7, started daemon 124035435873984)>, <Thread(tpool_thread_8, started daemon 124035427464896)>, <Thread(tpool_thread_9, started daemon 124035419055808)>, <Thread(tpool_thread_10, started daemon 124035410646720)>, <Thread(tpool_thread_11, started daemon 124035402237632)>, <Thread(tpool_thread_12, started daemon 124035393828544)>, <Thread(tpool_thread_13, started daemon 124035385419456)>, <Thread(tpool_thread_14, started daemon 124035377010368)>, <Thread(tpool_thread_15, started daemon 124035368601280)>, <Thread(tpool_thread_16, started daemon 124035360192192)>, <Thread(tpool_thread_17, started daemon 124035351783104)>, <Thread(tpool_thread_18, started daemon 124035343374016)>, <Thread(tpool_thread_19, started daemon 124035334964928)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:58:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-96da3fc2-0d3e-4c06-8335-5fce96987a89 tempest-SnapshotsActionsTest-884453636 None] Acquiring lock "cinder-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:58:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-96da3fc2-0d3e-4c06-8335-5fce96987a89 tempest-SnapshotsActionsTest-884453636 None] Lock "cinder-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:58:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-96da3fc2-0d3e-4c06-8335-5fce96987a89 tempest-SnapshotsActionsTest-884453636 None] Acquiring lock "cinder-quobyte-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:58:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-96da3fc2-0d3e-4c06-8335-5fce96987a89 tempest-SnapshotsActionsTest-884453636 None] Lock "cinder-quobyte-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" acquired by "delete_volume" :: waited 0.014s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:58:11 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[196722f7-de85-432b-941c-502dba1950ad]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:58:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-96da3fc2-0d3e-4c06-8335-5fce96987a89 tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:58:11 devstack sudo[110434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc
Jun 26 05:58:11 devstack sudo[110434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:12 devstack sudo[110434]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-96da3fc2-0d3e-4c06-8335-5fce96987a89 tempest-SnapshotsActionsTest-884453636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" returned: 0 in 0.767s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-96da3fc2-0d3e-4c06-8335-5fce96987a89 tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:58:12 devstack sudo[110440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc
Jun 26 05:58:12 devstack sudo[110440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:13 devstack sudo[110440]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-96da3fc2-0d3e-4c06-8335-5fce96987a89 tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" returned: 0 in 0.646s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:13 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-96da3fc2-0d3e-4c06-8335-5fce96987a89 tempest-SnapshotsActionsTest-884453636 None] Lock "cinder-quobyte-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc" released by "delete_volume" :: held 1.469s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:58:13 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-96da3fc2-0d3e-4c06-8335-5fce96987a89 tempest-SnapshotsActionsTest-884453636 None] Created reservations ['ce038842-8fad-4b13-9b92-e45fb026e632', '3465abe5-60cb-4c61-b2d5-80fbbb5f122c', '1beee267-34ad-48f6-a79e-fa9240ba3a70', '3dc43ab4-6a70-4417-b24f-79d33497c0a8'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:58:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-96da3fc2-0d3e-4c06-8335-5fce96987a89 tempest-SnapshotsActionsTest-884453636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:58:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-96da3fc2-0d3e-4c06-8335-5fce96987a89 tempest-SnapshotsActionsTest-884453636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:58:13 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-96da3fc2-0d3e-4c06-8335-5fce96987a89 tempest-SnapshotsActionsTest-884453636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:58:13 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-96da3fc2-0d3e-4c06-8335-5fce96987a89 tempest-SnapshotsActionsTest-884453636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:58:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-96da3fc2-0d3e-4c06-8335-5fce96987a89 tempest-SnapshotsActionsTest-884453636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:58:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-96da3fc2-0d3e-4c06-8335-5fce96987a89 tempest-SnapshotsActionsTest-884453636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:58:13 devstack sudo[110443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:58:13 devstack sudo[110443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:13 devstack sudo[110443]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-96da3fc2-0d3e-4c06-8335-5fce96987a89 tempest-SnapshotsActionsTest-884453636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.643s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:13 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-96da3fc2-0d3e-4c06-8335-5fce96987a89 tempest-SnapshotsActionsTest-884453636 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:58:13 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-96da3fc2-0d3e-4c06-8335-5fce96987a89 tempest-SnapshotsActionsTest-884453636 None] Deleted volume successfully.
Jun 26 05:58:13 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-96da3fc2-0d3e-4c06-8335-5fce96987a89 tempest-SnapshotsActionsTest-884453636 None] Lock "cinder-8449cdc8-7b9d-4fec-be6f-05e7c8543ebc-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Flow 'volume_create_manager' (d71849e2-74c5-4651-8d17-14b08f7cd37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76053e8c-d08c-47ce-aacf-8a182cb1aded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76053e8c-d08c-47ce-aacf-8a182cb1aded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1562947110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fec99a6-376f-4f8e-b0e9-5249b3caba2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2752266031d9467bb97bd06a5ed38832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:58:19Z,use_quota=True,user_id='a09adc8b42934ddabf2ad73ec94ee829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50499efa-954d-4ab1-afb2-03e5acfc6ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50499efa-954d-4ab1-afb2-03e5acfc6ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1c9df1-a80d-42e6-970e-8f40f6e50680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1c9df1-a80d-42e6-970e-8f40f6e50680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fec99a6-376f-4f8e-b0e9-5249b3caba2b', 'volume_name': 'volume-6fec99a6-376f-4f8e-b0e9-5249b3caba2b', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0be961-67b1-462e-ae05-0241ee8cf4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0be961-67b1-462e-ae05-0241ee8cf4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2585da4b-573e-4729-ba1c-511ab318bfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:58:18 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Volume 6fec99a6-376f-4f8e-b0e9-5249b3caba2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fec99a6-376f-4f8e-b0e9-5249b3caba2b', 'volume_size': 1}
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1562947110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fec99a6-376f-4f8e-b0e9-5249b3caba2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2752266031d9467bb97bd06a5ed38832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:58:19Z,use_quota=True,user_id='a09adc8b42934ddabf2ad73ec94ee829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Creating volume 6fec99a6-376f-4f8e-b0e9-5249b3caba2b {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:58:18 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:58:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6fec99a6-376f-4f8e-b0e9-5249b3caba2b 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:58:18 devstack sudo[110447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6fec99a6-376f-4f8e-b0e9-5249b3caba2b 1073741824
Jun 26 05:58:18 devstack sudo[110447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:19 devstack sudo[110447]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6fec99a6-376f-4f8e-b0e9-5249b3caba2b 1073741824" returned: 0 in 0.832s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:19 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=64,cinder:UPDATE=52,cinder:DELETE=6,cinder:INSERT=18 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:58:19 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=50,cinder:SELECT=57,cinder:INSERT=22,cinder:DELETE=2 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:58:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6fec99a6-376f-4f8e-b0e9-5249b3caba2b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:58:19 devstack sudo[110454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6fec99a6-376f-4f8e-b0e9-5249b3caba2b
Jun 26 05:58:19 devstack sudo[110454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:20 devstack sudo[110454]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6fec99a6-376f-4f8e-b0e9-5249b3caba2b" returned: 0 in 0.659s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:20 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:58:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:58:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2585da4b-573e-4729-ba1c-511ab318bfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fec99a6-376f-4f8e-b0e9-5249b3caba2b', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:58:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0da05f-35da-4889-9d8a-46f180be7424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:58:20 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Volume volume-6fec99a6-376f-4f8e-b0e9-5249b3caba2b (6fec99a6-376f-4f8e-b0e9-5249b3caba2b): created successfully
Jun 26 05:58:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0da05f-35da-4889-9d8a-46f180be7424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:58:20 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Flow 'volume_create_manager' (d71849e2-74c5-4651-8d17-14b08f7cd37b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:58:20 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-0f12b714-40e0-4185-a105-72bece31b6ce tempest-VolumesServicesTestJSON-22986954 None] Created volume successfully.
Jun 26 05:58:20 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e72c1dfa-b914-4eff-9234-977f2d8797a5 tempest-VolumesServicesTestJSON-22986954 None] Acquiring lock "cinder-6fec99a6-376f-4f8e-b0e9-5249b3caba2b-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:58:20 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e72c1dfa-b914-4eff-9234-977f2d8797a5 tempest-VolumesServicesTestJSON-22986954 None] Lock "cinder-6fec99a6-376f-4f8e-b0e9-5249b3caba2b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:58:21 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e72c1dfa-b914-4eff-9234-977f2d8797a5 tempest-VolumesServicesTestJSON-22986954 None] Acquiring lock "cinder-quobyte-6fec99a6-376f-4f8e-b0e9-5249b3caba2b" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:58:21 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e72c1dfa-b914-4eff-9234-977f2d8797a5 tempest-VolumesServicesTestJSON-22986954 None] Lock "cinder-quobyte-6fec99a6-376f-4f8e-b0e9-5249b3caba2b" acquired by "delete_volume" :: waited 0.014s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:58:21 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[103787ec-98aa-4fc5-a1df-d1e6e1ca0b3e]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:58:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e72c1dfa-b914-4eff-9234-977f2d8797a5 tempest-VolumesServicesTestJSON-22986954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6fec99a6-376f-4f8e-b0e9-5249b3caba2b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:58:21 devstack sudo[110461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6fec99a6-376f-4f8e-b0e9-5249b3caba2b
Jun 26 05:58:21 devstack sudo[110461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:21 devstack sudo[110461]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e72c1dfa-b914-4eff-9234-977f2d8797a5 tempest-VolumesServicesTestJSON-22986954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6fec99a6-376f-4f8e-b0e9-5249b3caba2b" returned: 0 in 0.754s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e72c1dfa-b914-4eff-9234-977f2d8797a5 tempest-VolumesServicesTestJSON-22986954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6fec99a6-376f-4f8e-b0e9-5249b3caba2b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:58:21 devstack sudo[110467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6fec99a6-376f-4f8e-b0e9-5249b3caba2b
Jun 26 05:58:21 devstack sudo[110467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:22 devstack sudo[110467]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e72c1dfa-b914-4eff-9234-977f2d8797a5 tempest-VolumesServicesTestJSON-22986954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6fec99a6-376f-4f8e-b0e9-5249b3caba2b" returned: 0 in 0.792s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:22 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e72c1dfa-b914-4eff-9234-977f2d8797a5 tempest-VolumesServicesTestJSON-22986954 None] Lock "cinder-quobyte-6fec99a6-376f-4f8e-b0e9-5249b3caba2b" released by "delete_volume" :: held 1.585s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:58:22 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-e72c1dfa-b914-4eff-9234-977f2d8797a5 tempest-VolumesServicesTestJSON-22986954 None] Created reservations ['754d36ea-a88e-4247-92e1-8a93eddc6395', 'e14c2e98-04ca-43ee-8a21-389877ad9d0f', '89731efa-fa72-4059-881f-06ae7e9f653c', 'a5a93679-056c-4829-a31a-a776d544713a'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:58:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e72c1dfa-b914-4eff-9234-977f2d8797a5 tempest-VolumesServicesTestJSON-22986954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:58:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e72c1dfa-b914-4eff-9234-977f2d8797a5 tempest-VolumesServicesTestJSON-22986954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:58:22 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e72c1dfa-b914-4eff-9234-977f2d8797a5 tempest-VolumesServicesTestJSON-22986954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:58:22 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e72c1dfa-b914-4eff-9234-977f2d8797a5 tempest-VolumesServicesTestJSON-22986954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:58:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e72c1dfa-b914-4eff-9234-977f2d8797a5 tempest-VolumesServicesTestJSON-22986954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:58:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e72c1dfa-b914-4eff-9234-977f2d8797a5 tempest-VolumesServicesTestJSON-22986954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:58:22 devstack sudo[110513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:58:22 devstack sudo[110513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:23 devstack sudo[110513]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e72c1dfa-b914-4eff-9234-977f2d8797a5 tempest-VolumesServicesTestJSON-22986954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.696s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:23 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-e72c1dfa-b914-4eff-9234-977f2d8797a5 tempest-VolumesServicesTestJSON-22986954 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:58:23 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e72c1dfa-b914-4eff-9234-977f2d8797a5 tempest-VolumesServicesTestJSON-22986954 None] Deleted volume successfully.
Jun 26 05:58:23 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e72c1dfa-b914-4eff-9234-977f2d8797a5 tempest-VolumesServicesTestJSON-22986954 None] Lock "cinder-6fec99a6-376f-4f8e-b0e9-5249b3caba2b-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:58:26 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-85e081ff-f72d-46f8-82de-728c581bb9ff req-159072a0-31f2-489d-87d6-372e0942e1b7 tempest-TestShelveInstance-1456519661 None] Terminate volume connection completed successfully.
Jun 26 05:58:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-85e081ff-f72d-46f8-82de-728c581bb9ff req-159072a0-31f2-489d-87d6-372e0942e1b7 tempest-TestShelveInstance-1456519661 None] Deleting attachment 41ae0741-6cc4-4865-bb5b-4a97995cd1ad. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 05:58:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-e480e1e1-d698-4d91-a7f6-e6612854534d req-95b29e39-e042-4c77-b768-f9abe36fa4f4 tempest-TestShelveInstance-1456519661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:58:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-e480e1e1-d698-4d91-a7f6-e6612854534d req-95b29e39-e042-4c77-b768-f9abe36fa4f4 tempest-TestShelveInstance-1456519661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:58:32 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba5c311-9c34-47d4-9462-99aab4930eaa]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:58:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-e480e1e1-d698-4d91-a7f6-e6612854534d req-95b29e39-e042-4c77-b768-f9abe36fa4f4 tempest-TestShelveInstance-1456519661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:58:32 devstack sudo[110567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1
Jun 26 05:58:32 devstack sudo[110567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:32 devstack sudo[110567]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-e480e1e1-d698-4d91-a7f6-e6612854534d req-95b29e39-e042-4c77-b768-f9abe36fa4f4 tempest-TestShelveInstance-1456519661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1" returned: 0 in 0.806s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-e480e1e1-d698-4d91-a7f6-e6612854534d req-95b29e39-e042-4c77-b768-f9abe36fa4f4 tempest-TestShelveInstance-1456519661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:58:32 devstack sudo[110572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1
Jun 26 05:58:32 devstack sudo[110572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:58:33 devstack sudo[110572]: pam_unix(sudo:session): session closed for user root
Jun 26 05:58:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-e480e1e1-d698-4d91-a7f6-e6612854534d req-95b29e39-e042-4c77-b768-f9abe36fa4f4 tempest-TestShelveInstance-1456519661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1" returned: 1 in 0.782s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:58:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-e480e1e1-d698-4d91-a7f6-e6612854534d req-95b29e39-e042-4c77-b768-f9abe36fa4f4 tempest-TestShelveInstance-1456519661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 05:58:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-e480e1e1-d698-4d91-a7f6-e6612854534d req-95b29e39-e042-4c77-b768-f9abe36fa4f4 tempest-TestShelveInstance-1456519661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.634s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:58:33 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-e480e1e1-d698-4d91-a7f6-e6612854534d req-95b29e39-e042-4c77-b768-f9abe36fa4f4 tempest-TestShelveInstance-1456519661 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85', 'name': 'volume-83d83807-c2ae-4d90-8cb3-8479f15296a1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95a03868-f547-4ddc-b73d-e7d5464f13b5', 'enforce_multipath': True} {{(pid=93708) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 05:58:33 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-e480e1e1-d698-4d91-a7f6-e6612854534d req-95b29e39-e042-4c77-b768-f9abe36fa4f4 tempest-TestShelveInstance-1456519661 None] attachment_update completed successfully.
Jun 26 05:58:43 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=10,cinder:SELECT=12,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:58:43 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=12,cinder:INSERT=4,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:59:04 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=1 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:59:04 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=1 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:59:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 05:59:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 28 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 05:59:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>, <Thread(tpool_thread_0, started daemon 124035494721216)>, <Thread(tpool_thread_1, started daemon 124035486328512)>, <Thread(tpool_thread_2, started daemon 124035477919424)>, <Thread(tpool_thread_3, started daemon 124035469510336)>, <Thread(tpool_thread_4, started daemon 124035461101248)>, <Thread(tpool_thread_5, started daemon 124035452692160)>, <Thread(tpool_thread_6, started daemon 124035444283072)>, <Thread(tpool_thread_7, started daemon 124035435873984)>, <Thread(tpool_thread_8, started daemon 124035427464896)>, <Thread(tpool_thread_9, started daemon 124035419055808)>, <Thread(tpool_thread_10, started daemon 124035410646720)>, <Thread(tpool_thread_11, started daemon 124035402237632)>, <Thread(tpool_thread_12, started daemon 124035393828544)>, <Thread(tpool_thread_13, started daemon 124035385419456)>, <Thread(tpool_thread_14, started daemon 124035377010368)>, <Thread(tpool_thread_15, started daemon 124035368601280)>, <Thread(tpool_thread_16, started daemon 124035360192192)>, <Thread(tpool_thread_17, started daemon 124035351783104)>, <Thread(tpool_thread_18, started daemon 124035343374016)>, <Thread(tpool_thread_19, started daemon 124035334964928)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Flow 'volume_create_manager' (0d02daf6-cb10-4de0-8d62-707d2be718bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c3366db-338e-4cb0-99f6-d2f41ff6b24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c3366db-338e-4cb0-99f6-d2f41ff6b24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-323954197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=013f2ca9-3740-4bb0-8a5c-9832cba73e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f5c34efa7d4ea59ad17ad27b66dc79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:59:18Z,use_quota=True,user_id='35590742856647e3aa3c200b99665594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9aace7a-b514-4f29-8ecd-ad8ea3a9452a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9aace7a-b514-4f29-8ecd-ad8ea3a9452a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c50ff09-08d1-40c4-93ba-b9fcf2f20b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c50ff09-08d1-40c4-93ba-b9fcf2f20b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '013f2ca9-3740-4bb0-8a5c-9832cba73e2d', 'volume_name': 'volume-013f2ca9-3740-4bb0-8a5c-9832cba73e2d', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e618d1-09b9-48a3-b201-599078e87901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e618d1-09b9-48a3-b201-599078e87901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5931dea-28c4-4926-9e5a-e9cc12a95824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:59:17 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Volume 013f2ca9-3740-4bb0-8a5c-9832cba73e2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-013f2ca9-3740-4bb0-8a5c-9832cba73e2d', 'volume_size': 1}
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T03:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-323954197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=013f2ca9-3740-4bb0-8a5c-9832cba73e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f5c34efa7d4ea59ad17ad27b66dc79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T03:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T03:59:18Z,use_quota=True,user_id='35590742856647e3aa3c200b99665594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Creating volume 013f2ca9-3740-4bb0-8a5c-9832cba73e2d {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 05:59:17 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 05:59:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f2ca9-3740-4bb0-8a5c-9832cba73e2d 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:59:18 devstack sudo[111209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f2ca9-3740-4bb0-8a5c-9832cba73e2d 1073741824
Jun 26 05:59:18 devstack sudo[111209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:59:18 devstack sudo[111209]: pam_unix(sudo:session): session closed for user root
Jun 26 05:59:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f2ca9-3740-4bb0-8a5c-9832cba73e2d 1073741824" returned: 0 in 0.858s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:59:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f2ca9-3740-4bb0-8a5c-9832cba73e2d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:59:18 devstack sudo[111214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f2ca9-3740-4bb0-8a5c-9832cba73e2d
Jun 26 05:59:18 devstack sudo[111214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:59:19 devstack sudo[111214]: pam_unix(sudo:session): session closed for user root
Jun 26 05:59:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f2ca9-3740-4bb0-8a5c-9832cba73e2d" returned: 0 in 0.664s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:59:19 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 05:59:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:59:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5931dea-28c4-4926-9e5a-e9cc12a95824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-013f2ca9-3740-4bb0-8a5c-9832cba73e2d', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:59:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df151b8-b9b8-4348-bb76-fa4ca4be0d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 05:59:19 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Volume volume-013f2ca9-3740-4bb0-8a5c-9832cba73e2d (013f2ca9-3740-4bb0-8a5c-9832cba73e2d): created successfully
Jun 26 05:59:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df151b8-b9b8-4348-bb76-fa4ca4be0d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 05:59:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Flow 'volume_create_manager' (0d02daf6-cb10-4de0-8d62-707d2be718bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 05:59:19 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-63eaca42-5caf-4e1c-90ea-b7e540ab07e5 tempest-TestMinimumBasicScenario-1673014690 None] Created volume successfully.
Jun 26 05:59:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-3813b590-ffdd-431f-b0d2-cc225831d30c req-2bd89ea6-2b79-4db1-85db-1aed51990689 tempest-TestMinimumBasicScenario-1673014690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:59:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-3813b590-ffdd-431f-b0d2-cc225831d30c req-2bd89ea6-2b79-4db1-85db-1aed51990689 tempest-TestMinimumBasicScenario-1673014690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:59:23 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[6810257a-2d25-4281-b313-9802f0181e5b]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:59:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-3813b590-ffdd-431f-b0d2-cc225831d30c req-2bd89ea6-2b79-4db1-85db-1aed51990689 tempest-TestMinimumBasicScenario-1673014690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f2ca9-3740-4bb0-8a5c-9832cba73e2d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:59:23 devstack sudo[111229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f2ca9-3740-4bb0-8a5c-9832cba73e2d
Jun 26 05:59:23 devstack sudo[111229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:59:23 devstack sudo[111229]: pam_unix(sudo:session): session closed for user root
Jun 26 05:59:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-3813b590-ffdd-431f-b0d2-cc225831d30c req-2bd89ea6-2b79-4db1-85db-1aed51990689 tempest-TestMinimumBasicScenario-1673014690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f2ca9-3740-4bb0-8a5c-9832cba73e2d" returned: 0 in 0.777s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:59:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-3813b590-ffdd-431f-b0d2-cc225831d30c req-2bd89ea6-2b79-4db1-85db-1aed51990689 tempest-TestMinimumBasicScenario-1673014690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.797s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:59:23 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-3813b590-ffdd-431f-b0d2-cc225831d30c req-2bd89ea6-2b79-4db1-85db-1aed51990689 tempest-TestMinimumBasicScenario-1673014690 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85', 'name': 'volume-013f2ca9-3740-4bb0-8a5c-9832cba73e2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01ed2c27-1461-4cc3-bc27-21ad999ed696', 'enforce_multipath': True} {{(pid=93708) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 05:59:24 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-3813b590-ffdd-431f-b0d2-cc225831d30c req-2bd89ea6-2b79-4db1-85db-1aed51990689 tempest-TestMinimumBasicScenario-1673014690 None] attachment_update completed successfully.
Jun 26 05:59:30 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-1d124a9d-0867-4230-a2c5-df40de4ec79f tempest-TestShelveInstance-1456519661 None] Terminate volume connection completed successfully.
Jun 26 05:59:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-1d124a9d-0867-4230-a2c5-df40de4ec79f tempest-TestShelveInstance-1456519661 None] Deleting attachment 95a03868-f547-4ddc-b73d-e7d5464f13b5. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 05:59:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] Acquiring lock "cinder-83d83807-c2ae-4d90-8cb3-8479f15296a1-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:59:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] Lock "cinder-83d83807-c2ae-4d90-8cb3-8479f15296a1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:59:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] Acquiring lock "cinder-quobyte-83d83807-c2ae-4d90-8cb3-8479f15296a1" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 05:59:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] Lock "cinder-quobyte-83d83807-c2ae-4d90-8cb3-8479f15296a1" acquired by "delete_volume" :: waited 0.034s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 05:59:31 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ccf22b-7278-460c-8828-24cc55710a68]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 05:59:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:59:31 devstack sudo[111341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1
Jun 26 05:59:31 devstack sudo[111341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:59:32 devstack sudo[111341]: pam_unix(sudo:session): session closed for user root
Jun 26 05:59:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1" returned: 0 in 0.814s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:59:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:59:32 devstack sudo[111346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1
Jun 26 05:59:32 devstack sudo[111346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:59:33 devstack sudo[111346]: pam_unix(sudo:session): session closed for user root
Jun 26 05:59:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1" returned: 1 in 0.883s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:59:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 05:59:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:59:33 devstack sudo[111351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1
Jun 26 05:59:33 devstack sudo[111351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:59:34 devstack sudo[111351]: pam_unix(sudo:session): session closed for user root
Jun 26 05:59:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-83d83807-c2ae-4d90-8cb3-8479f15296a1" returned: 0 in 0.844s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:59:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] Lock "cinder-quobyte-83d83807-c2ae-4d90-8cb3-8479f15296a1" released by "delete_volume" :: held 2.618s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:59:34 devstack cinder-volume[93708]: DEBUG cinder.quota [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] Created reservations ['10356c9d-08c6-4c04-84f9-9725825b81e8', 'c86af05b-300d-4a8e-96d1-4004569d4c1d', '4b5401ac-9410-4f6e-8678-52488b122f85', '00a9866d-b46e-4e96-915c-590a7944a124'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 05:59:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 05:59:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 05:59:34 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 05:59:34 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 05:59:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 05:59:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 05:59:34 devstack sudo[111355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 05:59:34 devstack sudo[111355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 05:59:35 devstack sudo[111355]: pam_unix(sudo:session): session closed for user root
Jun 26 05:59:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.761s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 05:59:35 devstack cinder-volume[93708]: DEBUG cinder.manager [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 05:59:35 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] Deleted volume successfully.
Jun 26 05:59:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [req-c77aeb6e-ee57-4f11-bb7b-ef2953ed5d96 req-a59d60e0-8890-49dd-8d94-059db344b35c tempest-TestShelveInstance-1456519661 None] Lock "cinder-83d83807-c2ae-4d90-8cb3-8479f15296a1-delete_volume" released by "delete_volume" :: held 3.646s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 05:59:44 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=13,cinder:SELECT=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 05:59:45 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=15,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Flow 'volume_create_manager' (7096a9c7-6b39-42ad-8af1-f5e10a141546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf8650e-c0c0-4656-8326-42dd83eb9f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf8650e-c0c0-4656-8326-42dd83eb9f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1647092927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e48d8e6-4471-48aa-8eb4-1a5d972a0f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150a499615fc403ba0ec8f07c6de257c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:00:07Z,use_quota=True,user_id='a0074fc0c2604312809bf06cb298032c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfb1b7b-7d64-4dfb-8796-8f8d30af155a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfb1b7b-7d64-4dfb-8796-8f8d30af155a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce72b5e0-aca5-4cd1-ae4d-9320f0866a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce72b5e0-aca5-4cd1-ae4d-9320f0866a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e48d8e6-4471-48aa-8eb4-1a5d972a0f36', 'volume_name': 'volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbfcb885-2a94-4dd5-996f-fa8157bab3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbfcb885-2a94-4dd5-996f-fa8157bab3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca7db46a-061d-49c3-b3d8-a37adb33b62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:00:07 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Volume 6e48d8e6-4471-48aa-8eb4-1a5d972a0f36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36', 'volume_size': 1}
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1647092927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e48d8e6-4471-48aa-8eb4-1a5d972a0f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150a499615fc403ba0ec8f07c6de257c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:00:07Z,use_quota=True,user_id='a0074fc0c2604312809bf06cb298032c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Creating volume 6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:00:07 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:00:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:00:07 devstack sudo[111505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 1073741824
Jun 26 06:00:07 devstack sudo[111505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:00:08 devstack sudo[111505]: pam_unix(sudo:session): session closed for user root
Jun 26 06:00:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 1073741824" returned: 0 in 0.999s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:00:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:00:08 devstack sudo[111522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36
Jun 26 06:00:08 devstack sudo[111522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:00:09 devstack sudo[111522]: pam_unix(sudo:session): session closed for user root
Jun 26 06:00:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36" returned: 0 in 0.759s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:00:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:00:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:00:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca7db46a-061d-49c3-b3d8-a37adb33b62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:00:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfeaedb1-aab1-4b24-9c32-c4f981c3d71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:00:09 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Volume volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 (6e48d8e6-4471-48aa-8eb4-1a5d972a0f36): created successfully
Jun 26 06:00:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfeaedb1-aab1-4b24-9c32-c4f981c3d71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:00:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Flow 'volume_create_manager' (7096a9c7-6b39-42ad-8af1-f5e10a141546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:00:09 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-15545bf3-cd03-401b-b0a9-2682254323a5 tempest-TestStampPattern-228189687 None] Created volume successfully.
Jun 26 06:00:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 06:00:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:00:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:00:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:00:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:00:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:00:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:00:10 devstack sudo[111529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:00:10 devstack sudo[111529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:00:11 devstack sudo[111529]: pam_unix(sudo:session): session closed for user root
Jun 26 06:00:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.651s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:00:11 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:00:11 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 06:00:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 28 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 06:00:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>, <Thread(tpool_thread_0, started daemon 124035494721216)>, <Thread(tpool_thread_1, started daemon 124035486328512)>, <Thread(tpool_thread_2, started daemon 124035477919424)>, <Thread(tpool_thread_3, started daemon 124035469510336)>, <Thread(tpool_thread_4, started daemon 124035461101248)>, <Thread(tpool_thread_5, started daemon 124035452692160)>, <Thread(tpool_thread_6, started daemon 124035444283072)>, <Thread(tpool_thread_7, started daemon 124035435873984)>, <Thread(tpool_thread_8, started daemon 124035427464896)>, <Thread(tpool_thread_9, started daemon 124035419055808)>, <Thread(tpool_thread_10, started daemon 124035410646720)>, <Thread(tpool_thread_11, started daemon 124035402237632)>, <Thread(tpool_thread_12, started daemon 124035393828544)>, <Thread(tpool_thread_13, started daemon 124035385419456)>, <Thread(tpool_thread_14, started daemon 124035377010368)>, <Thread(tpool_thread_15, started daemon 124035368601280)>, <Thread(tpool_thread_16, started daemon 124035360192192)>, <Thread(tpool_thread_17, started daemon 124035351783104)>, <Thread(tpool_thread_18, started daemon 124035343374016)>, <Thread(tpool_thread_19, started daemon 124035334964928)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 06:00:12 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-82dba14d-1850-4d46-acc8-2a43ce6f403d req-2dbc4ea7-97a0-4e36-bfec-eb75d04734c4 tempest-TestMinimumBasicScenario-1673014690 None] Terminate volume connection completed successfully.
Jun 26 06:00:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-82dba14d-1850-4d46-acc8-2a43ce6f403d req-2dbc4ea7-97a0-4e36-bfec-eb75d04734c4 tempest-TestMinimumBasicScenario-1673014690 None] Deleting attachment 01ed2c27-1461-4cc3-bc27-21ad999ed696. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 06:00:13 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7f8d9f7c-a84c-4aad-bbd9-ede66dac2406 tempest-TestMinimumBasicScenario-1673014690 None] Acquiring lock "cinder-013f2ca9-3740-4bb0-8a5c-9832cba73e2d-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:00:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7f8d9f7c-a84c-4aad-bbd9-ede66dac2406 tempest-TestMinimumBasicScenario-1673014690 None] Lock "cinder-013f2ca9-3740-4bb0-8a5c-9832cba73e2d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:00:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7f8d9f7c-a84c-4aad-bbd9-ede66dac2406 tempest-TestMinimumBasicScenario-1673014690 None] Acquiring lock "cinder-quobyte-013f2ca9-3740-4bb0-8a5c-9832cba73e2d" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:00:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7f8d9f7c-a84c-4aad-bbd9-ede66dac2406 tempest-TestMinimumBasicScenario-1673014690 None] Lock "cinder-quobyte-013f2ca9-3740-4bb0-8a5c-9832cba73e2d" acquired by "delete_volume" :: waited 0.032s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:00:14 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbf3cc3-6776-41f0-8140-3279341d5d3b]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:00:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7f8d9f7c-a84c-4aad-bbd9-ede66dac2406 tempest-TestMinimumBasicScenario-1673014690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f2ca9-3740-4bb0-8a5c-9832cba73e2d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:00:14 devstack sudo[111540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f2ca9-3740-4bb0-8a5c-9832cba73e2d
Jun 26 06:00:14 devstack sudo[111540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:00:14 devstack sudo[111540]: pam_unix(sudo:session): session closed for user root
Jun 26 06:00:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7f8d9f7c-a84c-4aad-bbd9-ede66dac2406 tempest-TestMinimumBasicScenario-1673014690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f2ca9-3740-4bb0-8a5c-9832cba73e2d" returned: 0 in 0.849s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:00:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7f8d9f7c-a84c-4aad-bbd9-ede66dac2406 tempest-TestMinimumBasicScenario-1673014690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f2ca9-3740-4bb0-8a5c-9832cba73e2d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:00:14 devstack sudo[111546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f2ca9-3740-4bb0-8a5c-9832cba73e2d
Jun 26 06:00:14 devstack sudo[111546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:00:15 devstack sudo[111546]: pam_unix(sudo:session): session closed for user root
Jun 26 06:00:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7f8d9f7c-a84c-4aad-bbd9-ede66dac2406 tempest-TestMinimumBasicScenario-1673014690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-013f2ca9-3740-4bb0-8a5c-9832cba73e2d" returned: 0 in 0.703s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:00:15 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7f8d9f7c-a84c-4aad-bbd9-ede66dac2406 tempest-TestMinimumBasicScenario-1673014690 None] Lock "cinder-quobyte-013f2ca9-3740-4bb0-8a5c-9832cba73e2d" released by "delete_volume" :: held 1.603s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:00:15 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-7f8d9f7c-a84c-4aad-bbd9-ede66dac2406 tempest-TestMinimumBasicScenario-1673014690 None] Created reservations ['f3163a9e-73fb-45ad-96f3-c0edd525c022', '8af03611-fe6e-42dd-b63f-ea65f52f8856', '0d9c91c8-af72-4865-b57c-ee05fa3b579f', '5df5bc86-5915-48aa-b0e2-6a0d4188130b'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:00:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7f8d9f7c-a84c-4aad-bbd9-ede66dac2406 tempest-TestMinimumBasicScenario-1673014690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:00:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7f8d9f7c-a84c-4aad-bbd9-ede66dac2406 tempest-TestMinimumBasicScenario-1673014690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:00:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7f8d9f7c-a84c-4aad-bbd9-ede66dac2406 tempest-TestMinimumBasicScenario-1673014690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:00:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7f8d9f7c-a84c-4aad-bbd9-ede66dac2406 tempest-TestMinimumBasicScenario-1673014690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:00:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7f8d9f7c-a84c-4aad-bbd9-ede66dac2406 tempest-TestMinimumBasicScenario-1673014690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:00:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7f8d9f7c-a84c-4aad-bbd9-ede66dac2406 tempest-TestMinimumBasicScenario-1673014690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:00:15 devstack sudo[111563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:00:15 devstack sudo[111563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:00:16 devstack sudo[111563]: pam_unix(sudo:session): session closed for user root
Jun 26 06:00:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7f8d9f7c-a84c-4aad-bbd9-ede66dac2406 tempest-TestMinimumBasicScenario-1673014690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.682s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:00:16 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-7f8d9f7c-a84c-4aad-bbd9-ede66dac2406 tempest-TestMinimumBasicScenario-1673014690 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:00:16 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-7f8d9f7c-a84c-4aad-bbd9-ede66dac2406 tempest-TestMinimumBasicScenario-1673014690 None] Deleted volume successfully.
Jun 26 06:00:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-7f8d9f7c-a84c-4aad-bbd9-ede66dac2406 tempest-TestMinimumBasicScenario-1673014690 None] Lock "cinder-013f2ca9-3740-4bb0-8a5c-9832cba73e2d-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:00:25 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 06:00:26 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=9,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 06:00:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-0e10df2b-3494-4515-96dd-ea7f92fc68b4 req-c32cabf1-9c11-4b6a-9e30-5859f480b6e4 tempest-TestStampPattern-228189687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:00:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-0e10df2b-3494-4515-96dd-ea7f92fc68b4 req-c32cabf1-9c11-4b6a-9e30-5859f480b6e4 tempest-TestStampPattern-228189687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:00:50 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec36f9b7-7081-46f8-b178-96d089289573]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:00:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-0e10df2b-3494-4515-96dd-ea7f92fc68b4 req-c32cabf1-9c11-4b6a-9e30-5859f480b6e4 tempest-TestStampPattern-228189687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:00:50 devstack sudo[111770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36
Jun 26 06:00:50 devstack sudo[111770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:00:50 devstack sudo[111770]: pam_unix(sudo:session): session closed for user root
Jun 26 06:00:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-0e10df2b-3494-4515-96dd-ea7f92fc68b4 req-c32cabf1-9c11-4b6a-9e30-5859f480b6e4 tempest-TestStampPattern-228189687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36" returned: 0 in 0.793s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:00:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-0e10df2b-3494-4515-96dd-ea7f92fc68b4 req-c32cabf1-9c11-4b6a-9e30-5859f480b6e4 tempest-TestStampPattern-228189687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.816s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:00:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-0e10df2b-3494-4515-96dd-ea7f92fc68b4 req-c32cabf1-9c11-4b6a-9e30-5859f480b6e4 tempest-TestStampPattern-228189687 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85', 'name': 'volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc69ed81-1ff8-4e9e-879d-88894e0655b0', 'enforce_multipath': True} {{(pid=93708) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 06:00:51 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-0e10df2b-3494-4515-96dd-ea7f92fc68b4 req-c32cabf1-9c11-4b6a-9e30-5859f480b6e4 tempest-TestStampPattern-228189687 None] attachment_update completed successfully.
Jun 26 06:00:59 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-a277089d-1b88-43d3-b371-ca508471eefa req-38d19100-a56d-4006-bda2-b98cd80eea8a tempest-TestStampPattern-228189687 None] Terminate volume connection completed successfully.
Jun 26 06:00:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-a277089d-1b88-43d3-b371-ca508471eefa req-38d19100-a56d-4006-bda2-b98cd80eea8a tempest-TestStampPattern-228189687 None] Deleting attachment fc69ed81-1ff8-4e9e-879d-88894e0655b0. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 06:01:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-db5e3619-7393-4e68-b061-e62e360a7352 tempest-TestStampPattern-228189687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:01:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-db5e3619-7393-4e68-b061-e62e360a7352 tempest-TestStampPattern-228189687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:01:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-db5e3619-7393-4e68-b061-e62e360a7352 tempest-TestStampPattern-228189687 None] Creating offline snapshot 5d4e06e8-4aec-4f8f-8747-2fbc669974eb of volume 6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 06:01:01 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[9535fed1-a3af-4f0d-8e05-2595eadef2ad]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:01:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e3619-7393-4e68-b061-e62e360a7352 tempest-TestStampPattern-228189687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:01:01 devstack sudo[112225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36
Jun 26 06:01:01 devstack sudo[112225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:01:02 devstack sudo[112225]: pam_unix(sudo:session): session closed for user root
Jun 26 06:01:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e3619-7393-4e68-b061-e62e360a7352 tempest-TestStampPattern-228189687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36" returned: 0 in 0.766s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:01:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e3619-7393-4e68-b061-e62e360a7352 tempest-TestStampPattern-228189687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:01:02 devstack sudo[112231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb 1G
Jun 26 06:01:02 devstack sudo[112231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:01:03 devstack sudo[112231]: pam_unix(sudo:session): session closed for user root
Jun 26 06:01:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e3619-7393-4e68-b061-e62e360a7352 tempest-TestStampPattern-228189687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb 1G" returned: 0 in 0.823s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:01:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e3619-7393-4e68-b061-e62e360a7352 tempest-TestStampPattern-228189687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:01:03 devstack sudo[112236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb
Jun 26 06:01:03 devstack sudo[112236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:01:03 devstack sudo[112236]: pam_unix(sudo:session): session closed for user root
Jun 26 06:01:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e3619-7393-4e68-b061-e62e360a7352 tempest-TestStampPattern-228189687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb" returned: 0 in 0.797s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:01:03 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-db5e3619-7393-4e68-b061-e62e360a7352 tempest-TestStampPattern-228189687 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb is being set with open permissions: ugo+rw
Jun 26 06:01:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e3619-7393-4e68-b061-e62e360a7352 tempest-TestStampPattern-228189687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:01:03 devstack sudo[112241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb
Jun 26 06:01:03 devstack sudo[112241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:01:04 devstack sudo[112241]: pam_unix(sudo:session): session closed for user root
Jun 26 06:01:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e3619-7393-4e68-b061-e62e360a7352 tempest-TestStampPattern-228189687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb" returned: 0 in 0.682s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:01:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e3619-7393-4e68-b061-e62e360a7352 tempest-TestStampPattern-228189687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:01:04 devstack sudo[112248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.info
Jun 26 06:01:04 devstack sudo[112248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:01:05 devstack sudo[112248]: pam_unix(sudo:session): session closed for user root
Jun 26 06:01:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e3619-7393-4e68-b061-e62e360a7352 tempest-TestStampPattern-228189687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.info" returned: 0 in 0.676s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:01:05 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-db5e3619-7393-4e68-b061-e62e360a7352 tempest-TestStampPattern-228189687 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.info is being set with open permissions: ugo+rw
Jun 26 06:01:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e3619-7393-4e68-b061-e62e360a7352 tempest-TestStampPattern-228189687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:01:05 devstack sudo[112265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.info
Jun 26 06:01:05 devstack sudo[112265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:01:05 devstack sudo[112265]: pam_unix(sudo:session): session closed for user root
Jun 26 06:01:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e3619-7393-4e68-b061-e62e360a7352 tempest-TestStampPattern-228189687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.info" returned: 0 in 0.637s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:01:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-db5e3619-7393-4e68-b061-e62e360a7352 tempest-TestStampPattern-228189687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.470s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:01:05 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-db5e3619-7393-4e68-b061-e62e360a7352 tempest-TestStampPattern-228189687 None] Create snapshot completed successfully
Jun 26 06:01:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 06:01:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:01:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:01:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:01:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:01:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:01:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:01:10 devstack sudo[112329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:01:10 devstack sudo[112329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:01:11 devstack sudo[112329]: pam_unix(sudo:session): session closed for user root
Jun 26 06:01:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.189s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:01:11 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:01:11 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 06:01:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 28 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 06:01:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>, <Thread(tpool_thread_0, started daemon 124035494721216)>, <Thread(tpool_thread_1, started daemon 124035486328512)>, <Thread(tpool_thread_2, started daemon 124035477919424)>, <Thread(tpool_thread_3, started daemon 124035469510336)>, <Thread(tpool_thread_4, started daemon 124035461101248)>, <Thread(tpool_thread_5, started daemon 124035452692160)>, <Thread(tpool_thread_6, started daemon 124035444283072)>, <Thread(tpool_thread_7, started daemon 124035435873984)>, <Thread(tpool_thread_8, started daemon 124035427464896)>, <Thread(tpool_thread_9, started daemon 124035419055808)>, <Thread(tpool_thread_10, started daemon 124035410646720)>, <Thread(tpool_thread_11, started daemon 124035402237632)>, <Thread(tpool_thread_12, started daemon 124035393828544)>, <Thread(tpool_thread_13, started daemon 124035385419456)>, <Thread(tpool_thread_14, started daemon 124035377010368)>, <Thread(tpool_thread_15, started daemon 124035368601280)>, <Thread(tpool_thread_16, started daemon 124035360192192)>, <Thread(tpool_thread_17, started daemon 124035351783104)>, <Thread(tpool_thread_18, started daemon 124035343374016)>, <Thread(tpool_thread_19, started daemon 124035334964928)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 06:01:15 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 06:01:15 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 06:01:17 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:01:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Flow 'volume_create_manager' (092fd13b-cbe9-4b5a-89ac-69cc4916d1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:01:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3bdbd4-f60a-489d-9b58-ea0fef7795af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:01:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3bdbd4-f60a-489d-9b58-ea0fef7795af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-584119356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150a499615fc403ba0ec8f07c6de257c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5d4e06e8-4aec-4f8f-8747-2fbc669974eb,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:01:18Z,use_quota=True,user_id='a0074fc0c2604312809bf06cb298032c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:01:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bffcea9d-5a36-4037-b287-d83c4c5cff20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:01:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bffcea9d-5a36-4037-b287-d83c4c5cff20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:01:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79b272b-8897-4f78-b35b-f9f98e618164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:01:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79b272b-8897-4f78-b35b-f9f98e618164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7', 'volume_name': 'volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7', 'volume_size': 1, 'snapshot_id': '5d4e06e8-4aec-4f8f-8747-2fbc669974eb'}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:01:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5433065-b047-44b3-a96a-17390fd58e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:01:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5433065-b047-44b3-a96a-17390fd58e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:01:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2119b62e-52be-42e6-af90-3ef1e8c427b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:01:17 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Volume 779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7', 'volume_size': 1, 'snapshot_id': '5d4e06e8-4aec-4f8f-8747-2fbc669974eb'}
Jun 26 06:01:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:01:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:01:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Acquiring lock "cinder-quobyte-5d4e06e8-4aec-4f8f-8747-2fbc669974eb-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7" by "_create_volume_from_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Lock "cinder-quobyte-5d4e06e8-4aec-4f8f-8747-2fbc669974eb-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Creating volume 779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7 from snapshot 5d4e06e8-4aec-4f8f-8747-2fbc669974eb {{(pid=93708) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Acquiring lock "cinder-quobyte-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7" by "_copy_volume_from_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Lock "cinder-quobyte-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] snapshot: 5d4e06e8-4aec-4f8f-8747-2fbc669974eb, volume: 779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7,  {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaaab0c-ce3e-4178-b360-e403ed0efe91]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:01:18 devstack sudo[112408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb
Jun 26 06:01:18 devstack sudo[112408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:01:18 devstack sudo[112408]: pam_unix(sudo:session): session closed for user root
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb" returned: 0 in 0.850s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Creating direct copy from snapshot {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d659d6-3ba6-4182-ab89-a106987f9bc4]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:01:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:01:19 devstack sudo[112416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36
Jun 26 06:01:19 devstack sudo[112416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:01:19 devstack sudo[112416]: pam_unix(sudo:session): session closed for user root
Jun 26 06:01:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36" returned: 0 in 0.837s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:01:19 devstack cinder-volume[93708]: DEBUG cinder.utils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Path /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7 not found in is_blk_device check {{(pid=93708) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 06:01:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:01:19 devstack sudo[112421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7
Jun 26 06:01:19 devstack sudo[112421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:01:26 devstack sudo[112421]: pam_unix(sudo:session): session closed for user root
Jun 26 06:01:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7" returned: 0 in 6.419s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:01:26 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1646e6f-9184-41a7-b4f4-6907a292e7f2]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:01:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:01:26 devstack sudo[112450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36
Jun 26 06:01:26 devstack sudo[112450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:01:27 devstack sudo[112450]: pam_unix(sudo:session): session closed for user root
Jun 26 06:01:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36" returned: 0 in 1.123s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:01:27 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Image conversion details: src /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36, size 1024.00 MB, duration 6.42 sec, destination /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7 {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 06:01:27 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Converted 1024.00 MB image at 159.50 MB/s
Jun 26 06:01:27 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7 is being set with open permissions: ugo+rw
Jun 26 06:01:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:01:27 devstack sudo[112457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7
Jun 26 06:01:27 devstack sudo[112457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:01:27 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=2 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 06:01:28 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 06:01:28 devstack sudo[112457]: pam_unix(sudo:session): session closed for user root
Jun 26 06:01:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7" returned: 0 in 0.697s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:01:28 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Lock "cinder-quobyte-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7" released by "_copy_volume_from_snapshot" :: held 10.037s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:01:28 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Lock "cinder-quobyte-5d4e06e8-4aec-4f8f-8747-2fbc669974eb-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7" released by "_create_volume_from_snapshot" :: held 10.076s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:01:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.095s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:01:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2119b62e-52be-42e6-af90-3ef1e8c427b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7', 'volume_size': 1, 'snapshot_id': '5d4e06e8-4aec-4f8f-8747-2fbc669974eb'}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:01:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb5a44c-1c0f-4794-a8d7-2de99670f508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:01:28 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Volume volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7 (779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7): created successfully
Jun 26 06:01:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb5a44c-1c0f-4794-a8d7-2de99670f508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:01:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Flow 'volume_create_manager' (092fd13b-cbe9-4b5a-89ac-69cc4916d1ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:01:28 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-013453ae-e5ab-4ffe-81b4-ec60e57c1037 tempest-TestStampPattern-228189687 None] Created volume successfully.
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Flow 'volume_create_manager' (6446fa95-226a-4e4b-b48a-12ae5af82e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fed31a7-4cd1-481a-861c-964e47023acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fed31a7-4cd1-481a-861c-964e47023acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-634382007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99bac213-a365-448c-872c-867375f2c99e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a25808963f9489a824bba95a383fd2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:01:37Z,use_quota=True,user_id='0a90ac24d3fd4d1183a9e1177095a986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33021f5c-e2f0-422a-8712-942c59f012a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33021f5c-e2f0-422a-8712-942c59f012a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daea5df4-97ec-491f-b6d6-4c9729536924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daea5df4-97ec-491f-b6d6-4c9729536924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99bac213-a365-448c-872c-867375f2c99e', 'volume_name': 'volume-99bac213-a365-448c-872c-867375f2c99e', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27978d45-74d6-41e7-a693-e611997308e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27978d45-74d6-41e7-a693-e611997308e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c34e05-c50a-4695-a93b-c96ed062eb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:01:36 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Volume 99bac213-a365-448c-872c-867375f2c99e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99bac213-a365-448c-872c-867375f2c99e', 'volume_size': 1}
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-634382007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99bac213-a365-448c-872c-867375f2c99e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a25808963f9489a824bba95a383fd2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:01:37Z,use_quota=True,user_id='0a90ac24d3fd4d1183a9e1177095a986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Creating volume 99bac213-a365-448c-872c-867375f2c99e {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:01:36 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:01:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-99bac213-a365-448c-872c-867375f2c99e 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:01:36 devstack sudo[112583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-99bac213-a365-448c-872c-867375f2c99e 1073741824
Jun 26 06:01:36 devstack sudo[112583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:01:37 devstack sudo[112583]: pam_unix(sudo:session): session closed for user root
Jun 26 06:01:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-99bac213-a365-448c-872c-867375f2c99e 1073741824" returned: 0 in 1.002s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:01:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-99bac213-a365-448c-872c-867375f2c99e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:01:37 devstack sudo[112588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-99bac213-a365-448c-872c-867375f2c99e
Jun 26 06:01:37 devstack sudo[112588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:01:38 devstack sudo[112588]: pam_unix(sudo:session): session closed for user root
Jun 26 06:01:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-99bac213-a365-448c-872c-867375f2c99e" returned: 0 in 0.815s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:01:38 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:01:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:01:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c34e05-c50a-4695-a93b-c96ed062eb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99bac213-a365-448c-872c-867375f2c99e', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:01:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307a649f-16f5-459f-8675-050037e4fac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:01:38 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Volume volume-99bac213-a365-448c-872c-867375f2c99e (99bac213-a365-448c-872c-867375f2c99e): created successfully
Jun 26 06:01:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307a649f-16f5-459f-8675-050037e4fac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:01:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Flow 'volume_create_manager' (6446fa95-226a-4e4b-b48a-12ae5af82e5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:01:38 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-6a754555-dbdc-40e8-9f1a-3ea54caf11d6 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Created volume successfully.
Jun 26 06:01:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-48b18b32-1db4-4d12-a0bd-6bc04c1fcab6 req-0667ae28-0b35-401b-9aa3-675dcff07982 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:01:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-48b18b32-1db4-4d12-a0bd-6bc04c1fcab6 req-0667ae28-0b35-401b-9aa3-675dcff07982 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:01:43 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[3648f60b-ecb3-44dd-9c83-046d0ae171e6]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:01:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-48b18b32-1db4-4d12-a0bd-6bc04c1fcab6 req-0667ae28-0b35-401b-9aa3-675dcff07982 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-99bac213-a365-448c-872c-867375f2c99e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:01:43 devstack sudo[112608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-99bac213-a365-448c-872c-867375f2c99e
Jun 26 06:01:43 devstack sudo[112608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:01:43 devstack sudo[112608]: pam_unix(sudo:session): session closed for user root
Jun 26 06:01:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-48b18b32-1db4-4d12-a0bd-6bc04c1fcab6 req-0667ae28-0b35-401b-9aa3-675dcff07982 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-99bac213-a365-448c-872c-867375f2c99e" returned: 0 in 0.789s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:01:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-48b18b32-1db4-4d12-a0bd-6bc04c1fcab6 req-0667ae28-0b35-401b-9aa3-675dcff07982 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.814s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:01:43 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-48b18b32-1db4-4d12-a0bd-6bc04c1fcab6 req-0667ae28-0b35-401b-9aa3-675dcff07982 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85', 'name': 'volume-99bac213-a365-448c-872c-867375f2c99e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb44f7e7-cbdc-45dd-b937-6b7767458335', 'enforce_multipath': True} {{(pid=93708) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 06:01:43 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-48b18b32-1db4-4d12-a0bd-6bc04c1fcab6 req-0667ae28-0b35-401b-9aa3-675dcff07982 tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] attachment_update completed successfully.
Jun 26 06:01:51 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-2a02f29d-4953-4e40-b710-e6a7567d1b58 req-a54739d8-d743-4b4b-9a59-582b26ad6dac tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Terminate volume connection completed successfully.
Jun 26 06:01:51 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-2a02f29d-4953-4e40-b710-e6a7567d1b58 req-a54739d8-d743-4b4b-9a59-582b26ad6dac tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Deleting attachment cb44f7e7-cbdc-45dd-b937-6b7767458335. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 06:01:52 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-273ad937-6079-4371-b4bd-2ca853ba035d tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Acquiring lock "cinder-99bac213-a365-448c-872c-867375f2c99e-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:01:52 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-273ad937-6079-4371-b4bd-2ca853ba035d tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Lock "cinder-99bac213-a365-448c-872c-867375f2c99e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:01:53 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-273ad937-6079-4371-b4bd-2ca853ba035d tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Acquiring lock "cinder-quobyte-99bac213-a365-448c-872c-867375f2c99e" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:01:53 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-273ad937-6079-4371-b4bd-2ca853ba035d tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Lock "cinder-quobyte-99bac213-a365-448c-872c-867375f2c99e" acquired by "delete_volume" :: waited 0.013s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:01:53 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[808e8f67-2398-4446-93b6-e8a5e5b49ecb]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:01:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-273ad937-6079-4371-b4bd-2ca853ba035d tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-99bac213-a365-448c-872c-867375f2c99e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:01:53 devstack sudo[113037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-99bac213-a365-448c-872c-867375f2c99e
Jun 26 06:01:53 devstack sudo[113037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:01:53 devstack sudo[113037]: pam_unix(sudo:session): session closed for user root
Jun 26 06:01:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-273ad937-6079-4371-b4bd-2ca853ba035d tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-99bac213-a365-448c-872c-867375f2c99e" returned: 0 in 0.740s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:01:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-273ad937-6079-4371-b4bd-2ca853ba035d tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-99bac213-a365-448c-872c-867375f2c99e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:01:53 devstack sudo[113042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-99bac213-a365-448c-872c-867375f2c99e
Jun 26 06:01:53 devstack sudo[113042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:01:54 devstack sudo[113042]: pam_unix(sudo:session): session closed for user root
Jun 26 06:01:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-273ad937-6079-4371-b4bd-2ca853ba035d tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-99bac213-a365-448c-872c-867375f2c99e" returned: 0 in 0.638s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:01:54 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-273ad937-6079-4371-b4bd-2ca853ba035d tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Lock "cinder-quobyte-99bac213-a365-448c-872c-867375f2c99e" released by "delete_volume" :: held 1.413s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:01:54 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-273ad937-6079-4371-b4bd-2ca853ba035d tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Created reservations ['6061b9fb-9bff-4772-a599-b99211937c0e', '2980faf5-13fe-4e8f-8540-9541b1eed131', 'b1cdb8d7-5d80-4d14-a93d-021dcd1ae811', '4b3531ad-f7d3-4e14-8edb-042543669073'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:01:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-273ad937-6079-4371-b4bd-2ca853ba035d tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:01:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-273ad937-6079-4371-b4bd-2ca853ba035d tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:01:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-273ad937-6079-4371-b4bd-2ca853ba035d tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:01:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-273ad937-6079-4371-b4bd-2ca853ba035d tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:01:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-273ad937-6079-4371-b4bd-2ca853ba035d tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:01:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-273ad937-6079-4371-b4bd-2ca853ba035d tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:01:54 devstack sudo[113045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:01:54 devstack sudo[113045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:01:55 devstack sudo[113045]: pam_unix(sudo:session): session closed for user root
Jun 26 06:01:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-273ad937-6079-4371-b4bd-2ca853ba035d tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.637s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:01:55 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-273ad937-6079-4371-b4bd-2ca853ba035d tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:01:55 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-273ad937-6079-4371-b4bd-2ca853ba035d tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Deleted volume successfully.
Jun 26 06:01:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-273ad937-6079-4371-b4bd-2ca853ba035d tempest-TestServerVolumeAttachScenarioOldVersion-900810945 None] Lock "cinder-99bac213-a365-448c-872c-867375f2c99e-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:02:04 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=17,cinder:UPDATE=13,cinder:INSERT=3 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 06:02:05 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=15,cinder:DELETE=3,cinder:SELECT=11,cinder:INSERT=2 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 06:02:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 06:02:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:02:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:02:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:10 devstack sudo[113116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:02:10 devstack sudo[113116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:11 devstack sudo[113116]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.745s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:11 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:02:11 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 06:02:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 28 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 06:02:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>, <Thread(tpool_thread_0, started daemon 124035494721216)>, <Thread(tpool_thread_1, started daemon 124035486328512)>, <Thread(tpool_thread_2, started daemon 124035477919424)>, <Thread(tpool_thread_3, started daemon 124035469510336)>, <Thread(tpool_thread_4, started daemon 124035461101248)>, <Thread(tpool_thread_5, started daemon 124035452692160)>, <Thread(tpool_thread_6, started daemon 124035444283072)>, <Thread(tpool_thread_7, started daemon 124035435873984)>, <Thread(tpool_thread_8, started daemon 124035427464896)>, <Thread(tpool_thread_9, started daemon 124035419055808)>, <Thread(tpool_thread_10, started daemon 124035410646720)>, <Thread(tpool_thread_11, started daemon 124035402237632)>, <Thread(tpool_thread_12, started daemon 124035393828544)>, <Thread(tpool_thread_13, started daemon 124035385419456)>, <Thread(tpool_thread_14, started daemon 124035377010368)>, <Thread(tpool_thread_15, started daemon 124035368601280)>, <Thread(tpool_thread_16, started daemon 124035360192192)>, <Thread(tpool_thread_17, started daemon 124035351783104)>, <Thread(tpool_thread_18, started daemon 124035343374016)>, <Thread(tpool_thread_19, started daemon 124035334964928)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 06:02:16 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:02:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Flow 'volume_create_manager' (38ede013-88f6-4e05-9149-053d0c96deaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:02:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc6933c-a354-4539-897f-3ea25770ad5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc6933c-a354-4539-897f-3ea25770ad5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9f0b48-2a9d-4dff-aded-862a39f7221d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a57b94ab34f41f78641e73cfab0efa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:02:16Z,use_quota=True,user_id='c8da7367d4c241cf8536a10286c3ce97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b860ccfd-2a24-4cf1-9ca9-e505f52b290e),volume_type_id=b860ccfd-2a24-4cf1-9ca9-e505f52b290e)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ed949b-be16-4e38-a25b-1efcd8c963e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ed949b-be16-4e38-a25b-1efcd8c963e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680afe17-8dfd-4321-b28a-2b0e2d7c3657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:16 devstack cinder-volume[93708]: DEBUG cinder.image.glance [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Creating Keystone auth plugin from conf {{(pid=93708) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 26 06:02:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680afe17-8dfd-4321-b28a-2b0e2d7c3657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fa9f0b48-2a9d-4dff-aded-862a39f7221d', 'volume_name': 'volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d', 'volume_size': 1, 'image_id': 'db32e782-4748-4ff5-af42-180d9682ba9b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db32e782-4748-4ff5-af42-180d9682ba9b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '43aa67bc91a431d54e0670f55876c1fc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7a57b94ab34f41f78641e73cfab0efa9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ceb3db190d036a237d6ccb6abb68bd636eb2fa798a5eab9fabb139e14798ca708bc133421c3d72751b95be4d4c8befab3a207203ac50919ceea19bd2e32cd96', 'id': 'db32e782-4748-4ff5-af42-180d9682ba9b', 'created_at': datetime.datetime(2026, 6, 26, 4, 2, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 4, 2, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db32e782-4748-4ff5-af42-180d9682ba9b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf43a584a0>}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c2c1dc-715e-448c-a0da-2adc7eb4f443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c2c1dc-715e-448c-a0da-2adc7eb4f443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a0f2a0-6d2e-44bc-a26c-897ccb175dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:16 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Volume fa9f0b48-2a9d-4dff-aded-862a39f7221d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d', 'volume_size': 1, 'image_id': 'db32e782-4748-4ff5-af42-180d9682ba9b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db32e782-4748-4ff5-af42-180d9682ba9b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '43aa67bc91a431d54e0670f55876c1fc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7a57b94ab34f41f78641e73cfab0efa9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ceb3db190d036a237d6ccb6abb68bd636eb2fa798a5eab9fabb139e14798ca708bc133421c3d72751b95be4d4c8befab3a207203ac50919ceea19bd2e32cd96', 'id': 'db32e782-4748-4ff5-af42-180d9682ba9b', 'created_at': datetime.datetime(2026, 6, 26, 4, 2, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 4, 2, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db32e782-4748-4ff5-af42-180d9682ba9b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf43a584a0>}
Jun 26 06:02:16 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Trying to clone fa9f0b48-2a9d-4dff-aded-862a39f7221d from image db32e782-4748-4ff5-af42-180d9682ba9b at location (None, [{'url': 'file:///opt/stack/data/glance/images/db32e782-4748-4ff5-af42-180d9682ba9b', 'metadata': {}}]). {{(pid=93708) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 26 06:02:16 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 26 06:02:16 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Image download 0.00 MB at 0.00 MB/s
Jun 26 06:02:16 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a29552-c91b-4cdc-aea7-8c25519bc74e]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:02:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:16 devstack sudo[113136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD
Jun 26 06:02:16 devstack sudo[113136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:17 devstack sudo[113136]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD" returned: 0 in 0.725s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:17 devstack sudo[113140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD
Jun 26 06:02:17 devstack sudo[113140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:18 devstack sudo[113140]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD" returned: 1 in 0.751s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:02:18 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Temporary image db32e782-4748-4ff5-af42-180d9682ba9b is fetched for user c8da7367d4c241cf8536a10286c3ce97. {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 26 06:02:18 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7af1435-b27c-42ba-8894-b10be06b5fb3]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:02:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-e2b78591-3fa3-4d87-a29f-17ed881a05c2 req-d324c5f6-5d31-4574-a1ab-e8ae7ba9c1d2 tempest-TestStampPattern-228189687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-e2b78591-3fa3-4d87-a29f-17ed881a05c2 req-d324c5f6-5d31-4574-a1ab-e8ae7ba9c1d2 tempest-TestStampPattern-228189687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:18 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfecea22-4546-4e6e-98e2-387f9f1d357f]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:02:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-e2b78591-3fa3-4d87-a29f-17ed881a05c2 req-d324c5f6-5d31-4574-a1ab-e8ae7ba9c1d2 tempest-TestStampPattern-228189687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:18 devstack sudo[113153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD
Jun 26 06:02:18 devstack sudo[113153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:18 devstack sudo[113154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7
Jun 26 06:02:18 devstack sudo[113154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:19 devstack sudo[113153]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD" returned: 0 in 0.766s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:19 devstack sudo[113154]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [req-e2b78591-3fa3-4d87-a29f-17ed881a05c2 req-d324c5f6-5d31-4574-a1ab-e8ae7ba9c1d2 tempest-TestStampPattern-228189687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7" returned: 0 in 0.775s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [req-e2b78591-3fa3-4d87-a29f-17ed881a05c2 req-d324c5f6-5d31-4574-a1ab-e8ae7ba9c1d2 tempest-TestStampPattern-228189687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.796s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:19 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-e2b78591-3fa3-4d87-a29f-17ed881a05c2 req-d324c5f6-5d31-4574-a1ab-e8ae7ba9c1d2 tempest-TestStampPattern-228189687 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85', 'name': 'volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74883082-4520-4747-a53b-56efc3eaa378', 'enforce_multipath': True} {{(pid=93708) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 26 06:02:19 devstack sudo[113162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD
Jun 26 06:02:19 devstack sudo[113162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:19 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-e2b78591-3fa3-4d87-a29f-17ed881a05c2 req-d324c5f6-5d31-4574-a1ab-e8ae7ba9c1d2 tempest-TestStampPattern-228189687 None] attachment_update completed successfully.
Jun 26 06:02:19 devstack sudo[113162]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD" returned: 1 in 0.756s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:02:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:19 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9f0b48-2a9d-4dff-aded-862a39f7221d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a57b94ab34f41f78641e73cfab0efa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:02:16Z,use_quota=True,user_id='c8da7367d4c241cf8536a10286c3ce97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b860ccfd-2a24-4cf1-9ca9-e505f52b290e),volume_type_id=b860ccfd-2a24-4cf1-9ca9-e505f52b290e)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:02:19 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Creating volume fa9f0b48-2a9d-4dff-aded-862a39f7221d {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:02:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:19 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:02:19 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:02:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:19 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:02:19 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:02:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:19 devstack sudo[113234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d 1073741824
Jun 26 06:02:19 devstack sudo[113234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:20 devstack sudo[113234]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d 1073741824" returned: 0 in 0.850s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:20 devstack sudo[113557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d
Jun 26 06:02:20 devstack sudo[113557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:21 devstack sudo[113557]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d" returned: 0 in 0.653s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:02:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:21 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Attempting download of db32e782-4748-4ff5-af42-180d9682ba9b ((None, [{'url': 'file:///opt/stack/data/glance/images/db32e782-4748-4ff5-af42-180d9682ba9b', 'metadata': {}}])) to volume fa9f0b48-2a9d-4dff-aded-862a39f7221d. {{(pid=93708) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 26 06:02:21 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[1477fb1f-f92b-47ab-a643-d1ea92930cc3]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:02:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db32e782-4748-4ff5-af42-180d9682ba9b_k9yz1i4b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:21 devstack sudo[113560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db32e782-4748-4ff5-af42-180d9682ba9b_k9yz1i4b
Jun 26 06:02:21 devstack sudo[113560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:22 devstack sudo[113560]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db32e782-4748-4ff5-af42-180d9682ba9b_k9yz1i4b" returned: 0 in 0.718s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db32e782-4748-4ff5-af42-180d9682ba9b_k9yz1i4b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:22 devstack sudo[113564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db32e782-4748-4ff5-af42-180d9682ba9b_k9yz1i4b
Jun 26 06:02:22 devstack sudo[113564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:22 devstack sudo[113564]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db32e782-4748-4ff5-af42-180d9682ba9b_k9yz1i4b" returned: 1 in 0.730s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db32e782-4748-4ff5-af42-180d9682ba9b_k9yz1i4b' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:02:22 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb7c7a4-b510-4ab9-bc44-e4f25b0500c6]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:02:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:23 devstack sudo[113569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD
Jun 26 06:02:23 devstack sudo[113569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:23 devstack sudo[113569]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD" returned: 0 in 0.729s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:23 devstack sudo[113585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD
Jun 26 06:02:23 devstack sudo[113585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:24 devstack sudo[113585]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD" returned: 1 in 0.777s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:02:24 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] db32e782-4748-4ff5-af42-180d9682ba9b was raw, converting to raw {{(pid=93708) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 26 06:02:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:24 devstack sudo[113594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d
Jun 26 06:02:24 devstack sudo[113594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:25 devstack sudo[113594]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d" returned: 0 in 0.706s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:25 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_db32e782-4748-4ff5-af42-180d9682ba9b_7_9tn14ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 06:02:25 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Converted 0.00 MB image at 0.00 MB/s
Jun 26 06:02:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:25 devstack sudo[113599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d 1G
Jun 26 06:02:25 devstack sudo[113599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:25 devstack cinder-volume[93708]: INFO cinder.volume.manager [req-cb428b1a-315d-452f-89ea-05e98cdf91b0 req-b90dd061-20e0-458b-87f2-076e5bae4fb7 tempest-TestStampPattern-228189687 None] Terminate volume connection completed successfully.
Jun 26 06:02:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [req-cb428b1a-315d-452f-89ea-05e98cdf91b0 req-b90dd061-20e0-458b-87f2-076e5bae4fb7 tempest-TestStampPattern-228189687 None] Deleting attachment 74883082-4520-4747-a53b-56efc3eaa378. {{(pid=93708) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 26 06:02:25 devstack sudo[113599]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d 1G" returned: 0 in 0.694s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:25 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[db890f11-a3de-4c5a-ba8e-228bd457be63]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:02:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:25 devstack sudo[113634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d
Jun 26 06:02:25 devstack sudo[113634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:26 devstack sudo[113634]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d" returned: 0 in 0.748s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:26 devstack sudo[113638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d
Jun 26 06:02:26 devstack sudo[113638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:27 devstack sudo[113638]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d" returned: 1 in 0.738s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:02:27 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Downloaded image db32e782-4748-4ff5-af42-180d9682ba9b ((None, [{'url': 'file:///opt/stack/data/glance/images/db32e782-4748-4ff5-af42-180d9682ba9b', 'metadata': {}}])) to volume fa9f0b48-2a9d-4dff-aded-862a39f7221d successfully. {{(pid=93708) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 26 06:02:27 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Temporary image db32e782-4748-4ff5-af42-180d9682ba9b for user c8da7367d4c241cf8536a10286c3ce97 is deleted. {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 26 06:02:27 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Marking volume fa9f0b48-2a9d-4dff-aded-862a39f7221d as bootable. {{(pid=93708) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 26 06:02:27 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Copying metadata from image db32e782-4748-4ff5-af42-180d9682ba9b to fa9f0b48-2a9d-4dff-aded-862a39f7221d. {{(pid=93708) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 26 06:02:27 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Creating volume glance metadata for volume fa9f0b48-2a9d-4dff-aded-862a39f7221d backed by image db32e782-4748-4ff5-af42-180d9682ba9b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'db32e782-4748-4ff5-af42-180d9682ba9b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '43aa67bc91a431d54e0670f55876c1fc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93708) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 26 06:02:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a0f2a0-6d2e-44bc-a26c-897ccb175dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d', 'volume_size': 1, 'image_id': 'db32e782-4748-4ff5-af42-180d9682ba9b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db32e782-4748-4ff5-af42-180d9682ba9b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '43aa67bc91a431d54e0670f55876c1fc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7a57b94ab34f41f78641e73cfab0efa9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ceb3db190d036a237d6ccb6abb68bd636eb2fa798a5eab9fabb139e14798ca708bc133421c3d72751b95be4d4c8befab3a207203ac50919ceea19bd2e32cd96', 'id': 'db32e782-4748-4ff5-af42-180d9682ba9b', 'created_at': datetime.datetime(2026, 6, 26, 4, 2, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 4, 2, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db32e782-4748-4ff5-af42-180d9682ba9b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf43a584a0>}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26a0a0a-e9e4-4ffc-b4c3-ee67e48d2d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:27 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Volume volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d (fa9f0b48-2a9d-4dff-aded-862a39f7221d): created successfully
Jun 26 06:02:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26a0a0a-e9e4-4ffc-b4c3-ee67e48d2d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:27 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Flow 'volume_create_manager' (38ede013-88f6-4e05-9149-053d0c96deaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:02:27 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-7bcf4815-760f-44fb-a4e9-f88f5f21e634 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Created volume successfully.
Jun 26 06:02:28 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Acquiring lock "cinder-fa9f0b48-2a9d-4dff-aded-862a39f7221d-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:02:28 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Lock "cinder-fa9f0b48-2a9d-4dff-aded-862a39f7221d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:02:28 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Acquiring lock "cinder-quobyte-fa9f0b48-2a9d-4dff-aded-862a39f7221d" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:02:28 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Lock "cinder-quobyte-fa9f0b48-2a9d-4dff-aded-862a39f7221d" acquired by "delete_volume" :: waited 0.017s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:02:28 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ee0db3-cdba-47c4-982c-4a182cc4e89b]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:02:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:28 devstack sudo[113645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d
Jun 26 06:02:28 devstack sudo[113645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:28 devstack sudo[113645]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d" returned: 0 in 0.807s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:29 devstack sudo[113649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d
Jun 26 06:02:29 devstack sudo[113649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:29 devstack sudo[113649]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d" returned: 1 in 0.957s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:02:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:29 devstack sudo[113689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d
Jun 26 06:02:29 devstack sudo[113689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:30 devstack sudo[113689]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fa9f0b48-2a9d-4dff-aded-862a39f7221d" returned: 0 in 0.649s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Lock "cinder-quobyte-fa9f0b48-2a9d-4dff-aded-862a39f7221d" released by "delete_volume" :: held 2.490s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:02:30 devstack cinder-volume[93708]: WARNING cinder.quota [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 26 06:02:30 devstack cinder-volume[93708]: WARNING cinder.quota [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 26 06:02:30 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Created reservations ['448d9be9-de17-4388-b91f-db16c6848985', '948459a2-8c8c-40cc-a585-68819ede4a02', '4bf79f38-dc84-4c73-ac5a-a08f41ea7371', '8033a61a-4956-404f-9186-7883e3bf5d53'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:02:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:30 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:02:30 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:02:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:30 devstack sudo[113693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:02:30 devstack sudo[113693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:31 devstack sudo[113693]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.692s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:31 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:02:31 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Deleted volume successfully.
Jun 26 06:02:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-288b6f03-40ef-4a57-9e95-a4be0cc7a275 tempest-VolumeAndVolumeTypeFromImageTest-680680620 None] Lock "cinder-fa9f0b48-2a9d-4dff-aded-862a39f7221d-delete_volume" released by "delete_volume" :: held 3.420s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Flow 'volume_create_manager' (f51f92b9-dad1-4258-a830-4a535018e660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e82ced-c114-4a80-bcc2-f6aa10847c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e82ced-c114-4a80-bcc2-f6aa10847c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1277729037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d3627c-37f3-40aa-98fc-71b3195af1ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034e9289e5bd4d18a38c52905a893e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:02:35Z,use_quota=True,user_id='56ad7b9f8d054963a87bc97a2072df57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e309dc38-977a-46fd-84d5-c588268957b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e309dc38-977a-46fd-84d5-c588268957b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161bac43-e78a-4e83-a6ce-02dbd77d9215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161bac43-e78a-4e83-a6ce-02dbd77d9215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45d3627c-37f3-40aa-98fc-71b3195af1ae', 'volume_name': 'volume-45d3627c-37f3-40aa-98fc-71b3195af1ae', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e1f730-524a-45c1-882e-e616c3c5c13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e1f730-524a-45c1-882e-e616c3c5c13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41659bb2-2fbd-4a75-adb0-4c7a471a3dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:35 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Volume 45d3627c-37f3-40aa-98fc-71b3195af1ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45d3627c-37f3-40aa-98fc-71b3195af1ae', 'volume_size': 1}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1277729037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d3627c-37f3-40aa-98fc-71b3195af1ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034e9289e5bd4d18a38c52905a893e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:02:35Z,use_quota=True,user_id='56ad7b9f8d054963a87bc97a2072df57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Creating volume 45d3627c-37f3-40aa-98fc-71b3195af1ae {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:02:35 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-45d3627c-37f3-40aa-98fc-71b3195af1ae 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:35 devstack sudo[113735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-45d3627c-37f3-40aa-98fc-71b3195af1ae 1073741824
Jun 26 06:02:35 devstack sudo[113735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9ab1a422-cd8e-46b5-8c4b-4f32e973d2cb tempest-TestStampPattern-228189687 None] Acquiring lock "cinder-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9ab1a422-cd8e-46b5-8c4b-4f32e973d2cb tempest-TestStampPattern-228189687 None] Lock "cinder-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Flow 'volume_create_manager' (b7cd594a-38e5-415c-89aa-2617dfaa0c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f640f94-30f3-427b-880b-8401ac070f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f640f94-30f3-427b-880b-8401ac070f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1052807309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=148a8c97-3991-4cbe-b6de-0acf9ee84c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034e9289e5bd4d18a38c52905a893e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:02:36Z,use_quota=True,user_id='56ad7b9f8d054963a87bc97a2072df57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:35 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fc15e3-45eb-42a6-b7bd-0637af2fe239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fc15e3-45eb-42a6-b7bd-0637af2fe239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aaa4e21-9b82-46e5-80c4-19674b995ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aaa4e21-9b82-46e5-80c4-19674b995ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '148a8c97-3991-4cbe-b6de-0acf9ee84c25', 'volume_name': 'volume-148a8c97-3991-4cbe-b6de-0acf9ee84c25', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7d4d22-0cf1-4e92-b383-a0762da59adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7d4d22-0cf1-4e92-b383-a0762da59adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4afd9f24-6047-4171-8b77-9c4ffc2e72f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:36 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Volume 148a8c97-3991-4cbe-b6de-0acf9ee84c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-148a8c97-3991-4cbe-b6de-0acf9ee84c25', 'volume_size': 1}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9ab1a422-cd8e-46b5-8c4b-4f32e973d2cb tempest-TestStampPattern-228189687 None] Acquiring lock "cinder-quobyte-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9ab1a422-cd8e-46b5-8c4b-4f32e973d2cb tempest-TestStampPattern-228189687 None] Lock "cinder-quobyte-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7" acquired by "delete_volume" :: waited 0.015s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[f654bcb4-95c6-4495-a3ab-4db47f16d221]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9ab1a422-cd8e-46b5-8c4b-4f32e973d2cb tempest-TestStampPattern-228189687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:36 devstack sudo[113737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7
Jun 26 06:02:36 devstack sudo[113737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Flow 'volume_create_manager' (e229b3ed-660d-4c3f-a396-d7c1a1684a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b650bb-1251-47ac-b472-e744723aad0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b650bb-1251-47ac-b472-e744723aad0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-924429900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4470ed-a51a-4e9c-b376-e8378b21ba1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034e9289e5bd4d18a38c52905a893e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:02:36Z,use_quota=True,user_id='56ad7b9f8d054963a87bc97a2072df57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a9b756-4ad6-469a-bf7d-b9781b131aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a9b756-4ad6-469a-bf7d-b9781b131aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6458b415-7304-4d9b-82eb-69e107da1ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6458b415-7304-4d9b-82eb-69e107da1ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b4470ed-a51a-4e9c-b376-e8378b21ba1d', 'volume_name': 'volume-5b4470ed-a51a-4e9c-b376-e8378b21ba1d', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2967b71f-9af5-467b-8930-8d5c87a9ad2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2967b71f-9af5-467b-8930-8d5c87a9ad2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caac0eb4-987e-4915-987b-dd77b4712781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:36 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Volume 5b4470ed-a51a-4e9c-b376-e8378b21ba1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b4470ed-a51a-4e9c-b376-e8378b21ba1d', 'volume_size': 1}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:36 devstack sudo[113735]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-45d3627c-37f3-40aa-98fc-71b3195af1ae 1073741824" returned: 0 in 0.988s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-45d3627c-37f3-40aa-98fc-71b3195af1ae {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:36 devstack sudo[113743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-45d3627c-37f3-40aa-98fc-71b3195af1ae
Jun 26 06:02:36 devstack sudo[113743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Flow 'volume_create_manager' (e7850344-be4b-44dc-b359-7c157216a099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47241ab-c00b-4415-a5c5-81f1af671c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47241ab-c00b-4415-a5c5-81f1af671c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-814818120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0643bbfa-23bb-46f2-8473-1d79fdfa06d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034e9289e5bd4d18a38c52905a893e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:02:37Z,use_quota=True,user_id='56ad7b9f8d054963a87bc97a2072df57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b99d0c-4044-430b-b937-c6f16837dfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b99d0c-4044-430b-b937-c6f16837dfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26082ebe-904e-44f9-ae83-c124e2f8a6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26082ebe-904e-44f9-ae83-c124e2f8a6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0643bbfa-23bb-46f2-8473-1d79fdfa06d0', 'volume_name': 'volume-0643bbfa-23bb-46f2-8473-1d79fdfa06d0', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc0a127-b192-4428-a826-c4ac42d6db75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc0a127-b192-4428-a826-c4ac42d6db75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031b0af4-f4d7-4169-b30e-6aba114effbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:36 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Volume 0643bbfa-23bb-46f2-8473-1d79fdfa06d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0643bbfa-23bb-46f2-8473-1d79fdfa06d0', 'volume_size': 1}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:36 devstack sudo[113737]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9ab1a422-cd8e-46b5-8c4b-4f32e973d2cb tempest-TestStampPattern-228189687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7" returned: 0 in 0.904s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9ab1a422-cd8e-46b5-8c4b-4f32e973d2cb tempest-TestStampPattern-228189687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:37 devstack sudo[113748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7
Jun 26 06:02:37 devstack sudo[113748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Flow 'volume_create_manager' (0dafe715-2222-45b7-8192-af6118c62e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c9cdf7-beed-431d-833b-a6bd7547229c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c9cdf7-beed-431d-833b-a6bd7547229c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1368311999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b6b554-1623-4c89-9313-e82aa7568064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034e9289e5bd4d18a38c52905a893e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:02:37Z,use_quota=True,user_id='56ad7b9f8d054963a87bc97a2072df57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b356f52-aba5-441f-bfd9-85ed6e04ef98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b356f52-aba5-441f-bfd9-85ed6e04ef98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a718015f-386a-4eed-870b-4383ca4d03e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a718015f-386a-4eed-870b-4383ca4d03e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b6b554-1623-4c89-9313-e82aa7568064', 'volume_name': 'volume-91b6b554-1623-4c89-9313-e82aa7568064', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971abcad-3908-451b-8ade-61ebdb7e21b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971abcad-3908-451b-8ade-61ebdb7e21b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b19413-95f5-4e24-9399-f713310b1d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:37 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Volume 91b6b554-1623-4c89-9313-e82aa7568064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b6b554-1623-4c89-9313-e82aa7568064', 'volume_size': 1}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:37 devstack sudo[113743]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-45d3627c-37f3-40aa-98fc-71b3195af1ae" returned: 0 in 0.759s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.370s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1052807309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=148a8c97-3991-4cbe-b6de-0acf9ee84c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034e9289e5bd4d18a38c52905a893e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:02:36Z,use_quota=True,user_id='56ad7b9f8d054963a87bc97a2072df57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Creating volume 148a8c97-3991-4cbe-b6de-0acf9ee84c25 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:02:37 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-148a8c97-3991-4cbe-b6de-0acf9ee84c25 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41659bb2-2fbd-4a75-adb0-4c7a471a3dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d3627c-37f3-40aa-98fc-71b3195af1ae', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02feb3cb-db57-4ccd-b788-c6ca82cead28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:37 devstack sudo[113751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-148a8c97-3991-4cbe-b6de-0acf9ee84c25 1073741824
Jun 26 06:02:37 devstack sudo[113751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:37 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Volume volume-45d3627c-37f3-40aa-98fc-71b3195af1ae (45d3627c-37f3-40aa-98fc-71b3195af1ae): created successfully
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02feb3cb-db57-4ccd-b788-c6ca82cead28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Flow 'volume_create_manager' (f51f92b9-dad1-4258-a830-4a535018e660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:02:37 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-ca736732-0ff2-46c4-b296-981fc4971170 tempest-CreateVolumesFromImageTest-1828515274 None] Created volume successfully.
Jun 26 06:02:37 devstack sudo[113748]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9ab1a422-cd8e-46b5-8c4b-4f32e973d2cb tempest-TestStampPattern-228189687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7" returned: 0 in 0.659s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9ab1a422-cd8e-46b5-8c4b-4f32e973d2cb tempest-TestStampPattern-228189687 None] Lock "cinder-quobyte-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7" released by "delete_volume" :: held 1.608s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-9ab1a422-cd8e-46b5-8c4b-4f32e973d2cb tempest-TestStampPattern-228189687 None] Created reservations ['4728e594-95bc-4c71-86ab-cb314e510604', 'e0e280e7-2de3-4d3d-9d8e-b08d7e5b7abc', 'fe6b335f-70a3-4566-b733-50fb8a6cd077', '7b40becf-98af-40d7-84fb-133ba6d2c57c'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9ab1a422-cd8e-46b5-8c4b-4f32e973d2cb tempest-TestStampPattern-228189687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9ab1a422-cd8e-46b5-8c4b-4f32e973d2cb tempest-TestStampPattern-228189687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9ab1a422-cd8e-46b5-8c4b-4f32e973d2cb tempest-TestStampPattern-228189687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9ab1a422-cd8e-46b5-8c4b-4f32e973d2cb tempest-TestStampPattern-228189687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9ab1a422-cd8e-46b5-8c4b-4f32e973d2cb tempest-TestStampPattern-228189687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9ab1a422-cd8e-46b5-8c4b-4f32e973d2cb tempest-TestStampPattern-228189687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:37 devstack sudo[113754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:02:37 devstack sudo[113754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:38 devstack sudo[113751]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-148a8c97-3991-4cbe-b6de-0acf9ee84c25 1073741824" returned: 0 in 0.903s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-148a8c97-3991-4cbe-b6de-0acf9ee84c25 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:38 devstack sudo[113761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-148a8c97-3991-4cbe-b6de-0acf9ee84c25
Jun 26 06:02:38 devstack sudo[113761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:38 devstack sudo[113754]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9ab1a422-cd8e-46b5-8c4b-4f32e973d2cb tempest-TestStampPattern-228189687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.707s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:38 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-9ab1a422-cd8e-46b5-8c4b-4f32e973d2cb tempest-TestStampPattern-228189687 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:02:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] Acquiring lock "cinder-5d4e06e8-4aec-4f8f-8747-2fbc669974eb-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:02:38 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-9ab1a422-cd8e-46b5-8c4b-4f32e973d2cb tempest-TestStampPattern-228189687 None] Deleted volume successfully.
Jun 26 06:02:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] Lock "cinder-5d4e06e8-4aec-4f8f-8747-2fbc669974eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:02:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] Acquiring lock "cinder-quobyte-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:02:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9ab1a422-cd8e-46b5-8c4b-4f32e973d2cb tempest-TestStampPattern-228189687 None] Lock "cinder-779b8471-eb0f-40a1-8ea2-4ea9e02bf9b7-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:02:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] Lock "cinder-quobyte-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:02:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] Acquiring lock "cinder-quobyte-5d4e06e8-4aec-4f8f-8747-2fbc669974eb" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:02:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] Lock "cinder-quobyte-5d4e06e8-4aec-4f8f-8747-2fbc669974eb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:02:38 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] Deleting offline snapshot 5d4e06e8-4aec-4f8f-8747-2fbc669974eb of volume 6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 06:02:38 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] snapshot_file for this snap is: volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 06:02:38 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[4437365d-fc13-44a9-98b8-d9fbd1ea2c02]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:02:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:38 devstack sudo[113763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb
Jun 26 06:02:38 devstack sudo[113763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:39 devstack sudo[113761]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-148a8c97-3991-4cbe-b6de-0acf9ee84c25" returned: 0 in 0.679s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.614s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-924429900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4470ed-a51a-4e9c-b376-e8378b21ba1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034e9289e5bd4d18a38c52905a893e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:02:36Z,use_quota=True,user_id='56ad7b9f8d054963a87bc97a2072df57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Creating volume 5b4470ed-a51a-4e9c-b376-e8378b21ba1d {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:02:39 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b4470ed-a51a-4e9c-b376-e8378b21ba1d 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:39 devstack sudo[113766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b4470ed-a51a-4e9c-b376-e8378b21ba1d 1073741824
Jun 26 06:02:39 devstack sudo[113766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4afd9f24-6047-4171-8b77-9c4ffc2e72f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-148a8c97-3991-4cbe-b6de-0acf9ee84c25', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b99a934-979f-4cdd-84cd-e16219d935f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:39 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Volume volume-148a8c97-3991-4cbe-b6de-0acf9ee84c25 (148a8c97-3991-4cbe-b6de-0acf9ee84c25): created successfully
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b99a934-979f-4cdd-84cd-e16219d935f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Flow 'volume_create_manager' (b7cd594a-38e5-415c-89aa-2617dfaa0c0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:02:39 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-610472e3-d790-48fd-93b6-6af95991b9a4 tempest-CreateVolumesFromImageTest-1828515274 None] Created volume successfully.
Jun 26 06:02:39 devstack sudo[113763]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb" returned: 0 in 0.793s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7c8193-3cf5-4247-a325-73e9680bb033]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:39 devstack sudo[113771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36
Jun 26 06:02:39 devstack sudo[113771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:39 devstack sudo[113766]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b4470ed-a51a-4e9c-b376-e8378b21ba1d 1073741824" returned: 0 in 0.834s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b4470ed-a51a-4e9c-b376-e8378b21ba1d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:39 devstack sudo[113776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b4470ed-a51a-4e9c-b376-e8378b21ba1d
Jun 26 06:02:39 devstack sudo[113776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:40 devstack sudo[113771]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36" returned: 0 in 0.753s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:40 devstack sudo[113781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb
Jun 26 06:02:40 devstack sudo[113781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:40 devstack sudo[113776]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b4470ed-a51a-4e9c-b376-e8378b21ba1d" returned: 0 in 0.643s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:02:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.684s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-814818120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0643bbfa-23bb-46f2-8473-1d79fdfa06d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034e9289e5bd4d18a38c52905a893e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:02:37Z,use_quota=True,user_id='56ad7b9f8d054963a87bc97a2072df57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:02:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Creating volume 0643bbfa-23bb-46f2-8473-1d79fdfa06d0 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:02:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:02:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:02:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:02:40 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:02:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0643bbfa-23bb-46f2-8473-1d79fdfa06d0 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:40 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caac0eb4-987e-4915-987b-dd77b4712781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b4470ed-a51a-4e9c-b376-e8378b21ba1d', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:40 devstack sudo[113784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0643bbfa-23bb-46f2-8473-1d79fdfa06d0 1073741824
Jun 26 06:02:40 devstack sudo[113784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:40 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80fdf6ce-b24d-4152-8b49-06eb5d4b0b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:40 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Volume volume-5b4470ed-a51a-4e9c-b376-e8378b21ba1d (5b4470ed-a51a-4e9c-b376-e8378b21ba1d): created successfully
Jun 26 06:02:40 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80fdf6ce-b24d-4152-8b49-06eb5d4b0b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:40 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Flow 'volume_create_manager' (e229b3ed-660d-4c3f-a396-d7c1a1684a98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:02:40 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-35b52c8a-403f-4466-aab7-c36c1a4b6da9 tempest-CreateVolumesFromImageTest-1828515274 None] Created volume successfully.
Jun 26 06:02:40 devstack sudo[113781]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb" returned: 0 in 0.723s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:40 devstack sudo[113789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb
Jun 26 06:02:40 devstack sudo[113789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:41 devstack sudo[113784]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0643bbfa-23bb-46f2-8473-1d79fdfa06d0 1073741824" returned: 0 in 0.840s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0643bbfa-23bb-46f2-8473-1d79fdfa06d0 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:41 devstack sudo[113795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0643bbfa-23bb-46f2-8473-1d79fdfa06d0
Jun 26 06:02:41 devstack sudo[113795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:41 devstack sudo[113789]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36.5d4e06e8-4aec-4f8f-8747-2fbc669974eb" returned: 0 in 0.631s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] Lock "cinder-quobyte-5d4e06e8-4aec-4f8f-8747-2fbc669974eb" released by "_delete_snapshot" :: held 2.995s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:02:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] Lock "cinder-quobyte-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36" released by "delete_snapshot" :: held 3.017s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:02:41 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] Created reservations ['8c9423a0-7741-484a-a6ae-559297aea31e', '139e9a8a-80fd-4396-a476-82a19b9e59ba', '48b2484e-68bd-447e-9fe1-03895378bcb0', 'e694c810-4ca1-40c1-9fbf-9c370ea830bd'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:02:41 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] Delete snapshot completed successfully.
Jun 26 06:02:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e614217f-fa1e-48fa-a311-22316e65b4ca tempest-TestStampPattern-228189687 None] Lock "cinder-5d4e06e8-4aec-4f8f-8747-2fbc669974eb-delete_snapshot" released by "delete_snapshot" :: held 3.162s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:02:42 devstack sudo[113795]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0643bbfa-23bb-46f2-8473-1d79fdfa06d0" returned: 0 in 0.633s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:02:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.890s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1368311999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b6b554-1623-4c89-9313-e82aa7568064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034e9289e5bd4d18a38c52905a893e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:02:37Z,use_quota=True,user_id='56ad7b9f8d054963a87bc97a2072df57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:02:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Creating volume 91b6b554-1623-4c89-9313-e82aa7568064 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:02:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:02:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:02:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:02:42 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:02:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-91b6b554-1623-4c89-9313-e82aa7568064 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:42 devstack sudo[113798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-91b6b554-1623-4c89-9313-e82aa7568064 1073741824
Jun 26 06:02:42 devstack sudo[113798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:42 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031b0af4-f4d7-4169-b30e-6aba114effbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0643bbfa-23bb-46f2-8473-1d79fdfa06d0', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:42 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b585632-f3d1-4596-a9f4-182562191eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:42 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Volume volume-0643bbfa-23bb-46f2-8473-1d79fdfa06d0 (0643bbfa-23bb-46f2-8473-1d79fdfa06d0): created successfully
Jun 26 06:02:42 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b585632-f3d1-4596-a9f4-182562191eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:42 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Flow 'volume_create_manager' (e7850344-be4b-44dc-b359-7c157216a099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:02:42 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-acd29dc2-b015-4762-abe0-bf0b7cfaa321 tempest-CreateVolumesFromImageTest-1828515274 None] Created volume successfully.
Jun 26 06:02:42 devstack sudo[113798]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-91b6b554-1623-4c89-9313-e82aa7568064 1073741824" returned: 0 in 0.844s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-91b6b554-1623-4c89-9313-e82aa7568064 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:42 devstack sudo[113805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-91b6b554-1623-4c89-9313-e82aa7568064
Jun 26 06:02:43 devstack sudo[113805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:43 devstack sudo[113805]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-91b6b554-1623-4c89-9313-e82aa7568064" returned: 0 in 0.659s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:43 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:02:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:43 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b19413-95f5-4e24-9399-f713310b1d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b6b554-1623-4c89-9313-e82aa7568064', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:43 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee5d5d4-cf3b-4311-a99c-98824cf55baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:43 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Volume volume-91b6b554-1623-4c89-9313-e82aa7568064 (91b6b554-1623-4c89-9313-e82aa7568064): created successfully
Jun 26 06:02:43 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee5d5d4-cf3b-4311-a99c-98824cf55baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:43 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Flow 'volume_create_manager' (0dafe715-2222-45b7-8192-af6118c62e3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:02:43 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-f820ac8f-beac-42fa-a37a-a04da8d45a4d tempest-CreateVolumesFromImageTest-1828515274 None] Created volume successfully.
Jun 26 06:02:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e9eb9561-ce5a-4bca-ae3d-709c51c4a976 tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "cinder-91b6b554-1623-4c89-9313-e82aa7568064-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:02:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e9eb9561-ce5a-4bca-ae3d-709c51c4a976 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "cinder-91b6b554-1623-4c89-9313-e82aa7568064-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:02:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e9eb9561-ce5a-4bca-ae3d-709c51c4a976 tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "cinder-quobyte-91b6b554-1623-4c89-9313-e82aa7568064" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:02:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e9eb9561-ce5a-4bca-ae3d-709c51c4a976 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "cinder-quobyte-91b6b554-1623-4c89-9313-e82aa7568064" acquired by "delete_volume" :: waited 0.038s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:02:44 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[0171abc2-6814-4377-9a4e-47a8b9fee08d]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:02:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e9eb9561-ce5a-4bca-ae3d-709c51c4a976 tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-91b6b554-1623-4c89-9313-e82aa7568064 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:45 devstack sudo[113834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-91b6b554-1623-4c89-9313-e82aa7568064
Jun 26 06:02:45 devstack sudo[113834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:45 devstack sudo[113834]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e9eb9561-ce5a-4bca-ae3d-709c51c4a976 tempest-CreateVolumesFromImageTest-1828515274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-91b6b554-1623-4c89-9313-e82aa7568064" returned: 0 in 0.844s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e9eb9561-ce5a-4bca-ae3d-709c51c4a976 tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-91b6b554-1623-4c89-9313-e82aa7568064 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:45 devstack sudo[113859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-91b6b554-1623-4c89-9313-e82aa7568064
Jun 26 06:02:45 devstack sudo[113859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:46 devstack sudo[113859]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e9eb9561-ce5a-4bca-ae3d-709c51c4a976 tempest-CreateVolumesFromImageTest-1828515274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-91b6b554-1623-4c89-9313-e82aa7568064" returned: 0 in 0.643s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:46 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e9eb9561-ce5a-4bca-ae3d-709c51c4a976 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "cinder-quobyte-91b6b554-1623-4c89-9313-e82aa7568064" released by "delete_volume" :: held 1.546s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:02:46 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-e9eb9561-ce5a-4bca-ae3d-709c51c4a976 tempest-CreateVolumesFromImageTest-1828515274 None] Created reservations ['55e98d21-b3e7-4b42-b72d-9aa95aeca92b', '95c7ee38-e7ee-4b1a-9515-951fcf4e4bd6', '64c71761-4d3a-41b7-b9be-f60ae875c76a', '190d0c18-20e7-4abd-bd10-81f1b425f5c4'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:02:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e9eb9561-ce5a-4bca-ae3d-709c51c4a976 tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e9eb9561-ce5a-4bca-ae3d-709c51c4a976 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:46 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e9eb9561-ce5a-4bca-ae3d-709c51c4a976 tempest-CreateVolumesFromImageTest-1828515274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:02:46 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e9eb9561-ce5a-4bca-ae3d-709c51c4a976 tempest-CreateVolumesFromImageTest-1828515274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:02:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e9eb9561-ce5a-4bca-ae3d-709c51c4a976 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e9eb9561-ce5a-4bca-ae3d-709c51c4a976 tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:46 devstack sudo[113864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:02:46 devstack sudo[113864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-bc8e4b13-db0c-4398-8cee-d96091c84865 tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "cinder-0643bbfa-23bb-46f2-8473-1d79fdfa06d0-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:02:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-bc8e4b13-db0c-4398-8cee-d96091c84865 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "cinder-0643bbfa-23bb-46f2-8473-1d79fdfa06d0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:02:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-bc8e4b13-db0c-4398-8cee-d96091c84865 tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "cinder-quobyte-0643bbfa-23bb-46f2-8473-1d79fdfa06d0" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:02:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-bc8e4b13-db0c-4398-8cee-d96091c84865 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "cinder-quobyte-0643bbfa-23bb-46f2-8473-1d79fdfa06d0" acquired by "delete_volume" :: waited 0.022s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:02:47 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[44503317-7fc6-4b05-a237-c4b03abcda2b]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:02:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bc8e4b13-db0c-4398-8cee-d96091c84865 tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0643bbfa-23bb-46f2-8473-1d79fdfa06d0 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:47 devstack sudo[113866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0643bbfa-23bb-46f2-8473-1d79fdfa06d0
Jun 26 06:02:47 devstack sudo[113866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:47 devstack sudo[113864]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e9eb9561-ce5a-4bca-ae3d-709c51c4a976 tempest-CreateVolumesFromImageTest-1828515274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.658s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:47 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-e9eb9561-ce5a-4bca-ae3d-709c51c4a976 tempest-CreateVolumesFromImageTest-1828515274 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:02:47 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e9eb9561-ce5a-4bca-ae3d-709c51c4a976 tempest-CreateVolumesFromImageTest-1828515274 None] Deleted volume successfully.
Jun 26 06:02:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e9eb9561-ce5a-4bca-ae3d-709c51c4a976 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "cinder-91b6b554-1623-4c89-9313-e82aa7568064-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:02:47 devstack sudo[113866]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bc8e4b13-db0c-4398-8cee-d96091c84865 tempest-CreateVolumesFromImageTest-1828515274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0643bbfa-23bb-46f2-8473-1d79fdfa06d0" returned: 0 in 0.786s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bc8e4b13-db0c-4398-8cee-d96091c84865 tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0643bbfa-23bb-46f2-8473-1d79fdfa06d0 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:47 devstack sudo[113872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0643bbfa-23bb-46f2-8473-1d79fdfa06d0
Jun 26 06:02:47 devstack sudo[113872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:48 devstack sudo[113872]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bc8e4b13-db0c-4398-8cee-d96091c84865 tempest-CreateVolumesFromImageTest-1828515274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0643bbfa-23bb-46f2-8473-1d79fdfa06d0" returned: 0 in 0.656s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:48 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-bc8e4b13-db0c-4398-8cee-d96091c84865 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "cinder-quobyte-0643bbfa-23bb-46f2-8473-1d79fdfa06d0" released by "delete_volume" :: held 1.478s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:02:48 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-bc8e4b13-db0c-4398-8cee-d96091c84865 tempest-CreateVolumesFromImageTest-1828515274 None] Created reservations ['4724b186-e9f6-40e4-9ab7-3ab8b36e5555', '509ead23-dae7-4b1f-af61-f09b069b33f7', '57c38a62-51f3-46dc-afb6-8f888f9d2c61', '9d768bff-6c64-4762-99a8-41188ed02afb'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:02:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-bc8e4b13-db0c-4398-8cee-d96091c84865 tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-bc8e4b13-db0c-4398-8cee-d96091c84865 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:48 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-bc8e4b13-db0c-4398-8cee-d96091c84865 tempest-CreateVolumesFromImageTest-1828515274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:02:48 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-bc8e4b13-db0c-4398-8cee-d96091c84865 tempest-CreateVolumesFromImageTest-1828515274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:02:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-bc8e4b13-db0c-4398-8cee-d96091c84865 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bc8e4b13-db0c-4398-8cee-d96091c84865 tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:48 devstack sudo[113875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:02:48 devstack sudo[113875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-875d59e0-c589-4798-8812-2fc032ebd8ce tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "cinder-5b4470ed-a51a-4e9c-b376-e8378b21ba1d-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:02:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-875d59e0-c589-4798-8812-2fc032ebd8ce tempest-CreateVolumesFromImageTest-1828515274 None] Lock "cinder-5b4470ed-a51a-4e9c-b376-e8378b21ba1d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:02:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-875d59e0-c589-4798-8812-2fc032ebd8ce tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "cinder-quobyte-5b4470ed-a51a-4e9c-b376-e8378b21ba1d" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:02:49 devstack sudo[113875]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bc8e4b13-db0c-4398-8cee-d96091c84865 tempest-CreateVolumesFromImageTest-1828515274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.688s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:49 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-bc8e4b13-db0c-4398-8cee-d96091c84865 tempest-CreateVolumesFromImageTest-1828515274 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:02:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-875d59e0-c589-4798-8812-2fc032ebd8ce tempest-CreateVolumesFromImageTest-1828515274 None] Lock "cinder-quobyte-5b4470ed-a51a-4e9c-b376-e8378b21ba1d" acquired by "delete_volume" :: waited 0.024s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:02:49 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-bc8e4b13-db0c-4398-8cee-d96091c84865 tempest-CreateVolumesFromImageTest-1828515274 None] Deleted volume successfully.
Jun 26 06:02:49 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[da276a5d-c784-432a-acbd-d5069923416e]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:02:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-875d59e0-c589-4798-8812-2fc032ebd8ce tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b4470ed-a51a-4e9c-b376-e8378b21ba1d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-bc8e4b13-db0c-4398-8cee-d96091c84865 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "cinder-0643bbfa-23bb-46f2-8473-1d79fdfa06d0-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:02:49 devstack sudo[113878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b4470ed-a51a-4e9c-b376-e8378b21ba1d
Jun 26 06:02:49 devstack sudo[113878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:50 devstack sudo[113878]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-875d59e0-c589-4798-8812-2fc032ebd8ce tempest-CreateVolumesFromImageTest-1828515274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b4470ed-a51a-4e9c-b376-e8378b21ba1d" returned: 0 in 0.777s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-875d59e0-c589-4798-8812-2fc032ebd8ce tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b4470ed-a51a-4e9c-b376-e8378b21ba1d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:50 devstack sudo[113883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b4470ed-a51a-4e9c-b376-e8378b21ba1d
Jun 26 06:02:50 devstack sudo[113883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:50 devstack sudo[113883]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-875d59e0-c589-4798-8812-2fc032ebd8ce tempest-CreateVolumesFromImageTest-1828515274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-5b4470ed-a51a-4e9c-b376-e8378b21ba1d" returned: 0 in 0.640s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:50 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-875d59e0-c589-4798-8812-2fc032ebd8ce tempest-CreateVolumesFromImageTest-1828515274 None] Lock "cinder-quobyte-5b4470ed-a51a-4e9c-b376-e8378b21ba1d" released by "delete_volume" :: held 1.469s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:02:50 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-875d59e0-c589-4798-8812-2fc032ebd8ce tempest-CreateVolumesFromImageTest-1828515274 None] Created reservations ['f1d80b72-424b-4f21-a5e9-71e22ab02c5d', '6e45e6ae-87d1-483c-828f-163524da9ada', '8b0d4100-bba4-4dd4-9d68-8e0b7f98bb27', 'ac05c615-18aa-4dc7-8494-6661195f0c8b'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:02:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-875d59e0-c589-4798-8812-2fc032ebd8ce tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-875d59e0-c589-4798-8812-2fc032ebd8ce tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:50 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-875d59e0-c589-4798-8812-2fc032ebd8ce tempest-CreateVolumesFromImageTest-1828515274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:02:50 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-875d59e0-c589-4798-8812-2fc032ebd8ce tempest-CreateVolumesFromImageTest-1828515274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:02:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-875d59e0-c589-4798-8812-2fc032ebd8ce tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-875d59e0-c589-4798-8812-2fc032ebd8ce tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:50 devstack sudo[113886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:02:50 devstack sudo[113886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:51 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c818081f-4e82-470b-ab50-1ddc6d5a1c63 tempest-TestStampPattern-228189687 None] Acquiring lock "cinder-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:02:51 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c818081f-4e82-470b-ab50-1ddc6d5a1c63 tempest-TestStampPattern-228189687 None] Lock "cinder-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:02:51 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c818081f-4e82-470b-ab50-1ddc6d5a1c63 tempest-TestStampPattern-228189687 None] Acquiring lock "cinder-quobyte-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:02:51 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c818081f-4e82-470b-ab50-1ddc6d5a1c63 tempest-TestStampPattern-228189687 None] Lock "cinder-quobyte-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36" acquired by "delete_volume" :: waited 0.015s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:02:51 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3268e3-26ba-4319-991d-1b13de81816f]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:02:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c818081f-4e82-470b-ab50-1ddc6d5a1c63 tempest-TestStampPattern-228189687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:51 devstack sudo[113888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36
Jun 26 06:02:51 devstack sudo[113888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:51 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a92d4dd8-12ce-4574-81dd-df624b1ee414 tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "cinder-148a8c97-3991-4cbe-b6de-0acf9ee84c25-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:02:51 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a92d4dd8-12ce-4574-81dd-df624b1ee414 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "cinder-148a8c97-3991-4cbe-b6de-0acf9ee84c25-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:02:51 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a92d4dd8-12ce-4574-81dd-df624b1ee414 tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "cinder-quobyte-148a8c97-3991-4cbe-b6de-0acf9ee84c25" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:02:51 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a92d4dd8-12ce-4574-81dd-df624b1ee414 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "cinder-quobyte-148a8c97-3991-4cbe-b6de-0acf9ee84c25" acquired by "delete_volume" :: waited 0.019s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:02:51 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6a9def-449f-40a8-92c8-ebadad93ecb4]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:02:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a92d4dd8-12ce-4574-81dd-df624b1ee414 tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-148a8c97-3991-4cbe-b6de-0acf9ee84c25 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:51 devstack sudo[113886]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-875d59e0-c589-4798-8812-2fc032ebd8ce tempest-CreateVolumesFromImageTest-1828515274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.706s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:51 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-875d59e0-c589-4798-8812-2fc032ebd8ce tempest-CreateVolumesFromImageTest-1828515274 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:02:51 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-875d59e0-c589-4798-8812-2fc032ebd8ce tempest-CreateVolumesFromImageTest-1828515274 None] Deleted volume successfully.
Jun 26 06:02:51 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-875d59e0-c589-4798-8812-2fc032ebd8ce tempest-CreateVolumesFromImageTest-1828515274 None] Lock "cinder-5b4470ed-a51a-4e9c-b376-e8378b21ba1d-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:02:51 devstack sudo[113891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-148a8c97-3991-4cbe-b6de-0acf9ee84c25
Jun 26 06:02:51 devstack sudo[113891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:52 devstack sudo[113888]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c818081f-4e82-470b-ab50-1ddc6d5a1c63 tempest-TestStampPattern-228189687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36" returned: 0 in 0.768s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c818081f-4e82-470b-ab50-1ddc6d5a1c63 tempest-TestStampPattern-228189687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:52 devstack sudo[113896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36
Jun 26 06:02:52 devstack sudo[113896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:52 devstack sudo[113891]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a92d4dd8-12ce-4574-81dd-df624b1ee414 tempest-CreateVolumesFromImageTest-1828515274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-148a8c97-3991-4cbe-b6de-0acf9ee84c25" returned: 0 in 0.771s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a92d4dd8-12ce-4574-81dd-df624b1ee414 tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-148a8c97-3991-4cbe-b6de-0acf9ee84c25 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:52 devstack sudo[113902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-148a8c97-3991-4cbe-b6de-0acf9ee84c25
Jun 26 06:02:52 devstack sudo[113902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:52 devstack sudo[113896]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c818081f-4e82-470b-ab50-1ddc6d5a1c63 tempest-TestStampPattern-228189687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36" returned: 0 in 0.653s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:52 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c818081f-4e82-470b-ab50-1ddc6d5a1c63 tempest-TestStampPattern-228189687 None] Lock "cinder-quobyte-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36" released by "delete_volume" :: held 1.485s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:02:52 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-c818081f-4e82-470b-ab50-1ddc6d5a1c63 tempest-TestStampPattern-228189687 None] Created reservations ['2c564a68-d103-4e95-87f5-c41b53496bed', '51bd1848-bef2-45e2-bf10-f066f974c5d8', '3a47a4d7-5d8f-47b8-8dc7-4151b9e66525', '3b54e1f4-e385-438f-bfda-14beab4b19fb'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:02:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c818081f-4e82-470b-ab50-1ddc6d5a1c63 tempest-TestStampPattern-228189687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c818081f-4e82-470b-ab50-1ddc6d5a1c63 tempest-TestStampPattern-228189687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:52 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c818081f-4e82-470b-ab50-1ddc6d5a1c63 tempest-TestStampPattern-228189687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:02:52 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-c818081f-4e82-470b-ab50-1ddc6d5a1c63 tempest-TestStampPattern-228189687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:02:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-c818081f-4e82-470b-ab50-1ddc6d5a1c63 tempest-TestStampPattern-228189687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c818081f-4e82-470b-ab50-1ddc6d5a1c63 tempest-TestStampPattern-228189687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:52 devstack sudo[113905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:02:52 devstack sudo[113905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:53 devstack sudo[113902]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a92d4dd8-12ce-4574-81dd-df624b1ee414 tempest-CreateVolumesFromImageTest-1828515274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-148a8c97-3991-4cbe-b6de-0acf9ee84c25" returned: 0 in 0.662s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:53 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a92d4dd8-12ce-4574-81dd-df624b1ee414 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "cinder-quobyte-148a8c97-3991-4cbe-b6de-0acf9ee84c25" released by "delete_volume" :: held 1.478s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:02:53 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-a92d4dd8-12ce-4574-81dd-df624b1ee414 tempest-CreateVolumesFromImageTest-1828515274 None] Created reservations ['6d8ebff5-ad49-47b0-82a9-2c926698287c', 'ec3b5f12-66a4-4aad-a349-a48057f92ce1', '432ee370-03e8-48c4-a28e-4aef05144af1', 'e2aa53f5-2c55-442f-9fde-2423c2f56b21'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:02:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a92d4dd8-12ce-4574-81dd-df624b1ee414 tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a92d4dd8-12ce-4574-81dd-df624b1ee414 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:53 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a92d4dd8-12ce-4574-81dd-df624b1ee414 tempest-CreateVolumesFromImageTest-1828515274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:02:53 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a92d4dd8-12ce-4574-81dd-df624b1ee414 tempest-CreateVolumesFromImageTest-1828515274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:02:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a92d4dd8-12ce-4574-81dd-df624b1ee414 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a92d4dd8-12ce-4574-81dd-df624b1ee414 tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:53 devstack sudo[113908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:02:53 devstack sudo[113908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:53 devstack sudo[113905]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c818081f-4e82-470b-ab50-1ddc6d5a1c63 tempest-TestStampPattern-228189687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.659s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:53 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-c818081f-4e82-470b-ab50-1ddc6d5a1c63 tempest-TestStampPattern-228189687 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:02:53 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-c818081f-4e82-470b-ab50-1ddc6d5a1c63 tempest-TestStampPattern-228189687 None] Deleted volume successfully.
Jun 26 06:02:53 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c818081f-4e82-470b-ab50-1ddc6d5a1c63 tempest-TestStampPattern-228189687 None] Lock "cinder-6e48d8e6-4471-48aa-8eb4-1a5d972a0f36-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:02:53 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-191bba66-2193-4620-b041-b2c0c6d723a4 tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "cinder-45d3627c-37f3-40aa-98fc-71b3195af1ae-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:02:53 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-191bba66-2193-4620-b041-b2c0c6d723a4 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "cinder-45d3627c-37f3-40aa-98fc-71b3195af1ae-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:02:53 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-191bba66-2193-4620-b041-b2c0c6d723a4 tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "cinder-quobyte-45d3627c-37f3-40aa-98fc-71b3195af1ae" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:02:53 devstack sudo[113908]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:53 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-191bba66-2193-4620-b041-b2c0c6d723a4 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "cinder-quobyte-45d3627c-37f3-40aa-98fc-71b3195af1ae" acquired by "delete_volume" :: waited 0.029s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:02:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a92d4dd8-12ce-4574-81dd-df624b1ee414 tempest-CreateVolumesFromImageTest-1828515274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.739s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:53 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-a92d4dd8-12ce-4574-81dd-df624b1ee414 tempest-CreateVolumesFromImageTest-1828515274 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:02:53 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-a92d4dd8-12ce-4574-81dd-df624b1ee414 tempest-CreateVolumesFromImageTest-1828515274 None] Deleted volume successfully.
Jun 26 06:02:53 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[caab428c-2cfa-483b-a42a-fc936aeff7f9]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:02:53 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-191bba66-2193-4620-b041-b2c0c6d723a4 tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-45d3627c-37f3-40aa-98fc-71b3195af1ae {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:53 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a92d4dd8-12ce-4574-81dd-df624b1ee414 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "cinder-148a8c97-3991-4cbe-b6de-0acf9ee84c25-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:02:54 devstack sudo[113912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-45d3627c-37f3-40aa-98fc-71b3195af1ae
Jun 26 06:02:54 devstack sudo[113912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:54 devstack sudo[113912]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-191bba66-2193-4620-b041-b2c0c6d723a4 tempest-CreateVolumesFromImageTest-1828515274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-45d3627c-37f3-40aa-98fc-71b3195af1ae" returned: 0 in 0.815s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-191bba66-2193-4620-b041-b2c0c6d723a4 tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-45d3627c-37f3-40aa-98fc-71b3195af1ae {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:54 devstack sudo[113917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-45d3627c-37f3-40aa-98fc-71b3195af1ae
Jun 26 06:02:54 devstack sudo[113917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:55 devstack sudo[113917]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-191bba66-2193-4620-b041-b2c0c6d723a4 tempest-CreateVolumesFromImageTest-1828515274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-45d3627c-37f3-40aa-98fc-71b3195af1ae" returned: 0 in 0.685s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-191bba66-2193-4620-b041-b2c0c6d723a4 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "cinder-quobyte-45d3627c-37f3-40aa-98fc-71b3195af1ae" released by "delete_volume" :: held 1.552s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:02:55 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-191bba66-2193-4620-b041-b2c0c6d723a4 tempest-CreateVolumesFromImageTest-1828515274 None] Created reservations ['e909d6a8-ffb9-4119-b301-8689c172c7c9', '63e131e5-3e31-4e73-87be-33065039385e', '40095cf0-87c4-4e0b-838b-5b35b957694b', 'c30b166a-4be3-45ad-a61a-40da2fae3354'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:02:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-191bba66-2193-4620-b041-b2c0c6d723a4 tempest-CreateVolumesFromImageTest-1828515274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-191bba66-2193-4620-b041-b2c0c6d723a4 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:55 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-191bba66-2193-4620-b041-b2c0c6d723a4 tempest-CreateVolumesFromImageTest-1828515274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:02:55 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-191bba66-2193-4620-b041-b2c0c6d723a4 tempest-CreateVolumesFromImageTest-1828515274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:02:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-191bba66-2193-4620-b041-b2c0c6d723a4 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-191bba66-2193-4620-b041-b2c0c6d723a4 tempest-CreateVolumesFromImageTest-1828515274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:55 devstack sudo[113921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:02:55 devstack sudo[113921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:02:56 devstack sudo[113921]: pam_unix(sudo:session): session closed for user root
Jun 26 06:02:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-191bba66-2193-4620-b041-b2c0c6d723a4 tempest-CreateVolumesFromImageTest-1828515274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.656s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:02:56 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-191bba66-2193-4620-b041-b2c0c6d723a4 tempest-CreateVolumesFromImageTest-1828515274 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:02:56 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-191bba66-2193-4620-b041-b2c0c6d723a4 tempest-CreateVolumesFromImageTest-1828515274 None] Deleted volume successfully.
Jun 26 06:02:56 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-191bba66-2193-4620-b041-b2c0c6d723a4 tempest-CreateVolumesFromImageTest-1828515274 None] Lock "cinder-45d3627c-37f3-40aa-98fc-71b3195af1ae-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Flow 'volume_create_manager' (d85068e3-5b7b-4662-a3b1-6d0cdefb76c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137bc3e8-21e7-44f1-b51d-c660a640a703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137bc3e8-21e7-44f1-b51d-c660a640a703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1497194154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c360c7-0a64-4a13-b88a-ee945fb5dcb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed0bd19ab46493da4fee760ed469e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:02:59Z,use_quota=True,user_id='398e5a720cc3496c9e6f3f6e08d9e1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c032d991-0f8a-42d9-af2a-7d55ee3bdc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c032d991-0f8a-42d9-af2a-7d55ee3bdc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4d3f9f-f851-4fb8-826c-ffad3d11cf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4d3f9f-f851-4fb8-826c-ffad3d11cf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c360c7-0a64-4a13-b88a-ee945fb5dcb3', 'volume_name': 'volume-40c360c7-0a64-4a13-b88a-ee945fb5dcb3', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f3f245a-83ec-48fb-b6d6-041fcb72be07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f3f245a-83ec-48fb-b6d6-041fcb72be07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6854707-f729-481f-9853-c84f6be72684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:02:59 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Volume 40c360c7-0a64-4a13-b88a-ee945fb5dcb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c360c7-0a64-4a13-b88a-ee945fb5dcb3', 'volume_size': 1}
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1497194154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c360c7-0a64-4a13-b88a-ee945fb5dcb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed0bd19ab46493da4fee760ed469e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:02:59Z,use_quota=True,user_id='398e5a720cc3496c9e6f3f6e08d9e1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Creating volume 40c360c7-0a64-4a13-b88a-ee945fb5dcb3 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:02:59 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:02:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-40c360c7-0a64-4a13-b88a-ee945fb5dcb3 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:02:59 devstack sudo[113925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-40c360c7-0a64-4a13-b88a-ee945fb5dcb3 1073741824
Jun 26 06:02:59 devstack sudo[113925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:00 devstack sudo[113925]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-40c360c7-0a64-4a13-b88a-ee945fb5dcb3 1073741824" returned: 0 in 0.849s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-40c360c7-0a64-4a13-b88a-ee945fb5dcb3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:00 devstack sudo[113932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-40c360c7-0a64-4a13-b88a-ee945fb5dcb3
Jun 26 06:03:00 devstack sudo[113932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:00 devstack sudo[113932]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-40c360c7-0a64-4a13-b88a-ee945fb5dcb3" returned: 0 in 0.684s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:00 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:03:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6854707-f729-481f-9853-c84f6be72684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c360c7-0a64-4a13-b88a-ee945fb5dcb3', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f478da-c754-4657-abe7-e6729756bb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:00 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Volume volume-40c360c7-0a64-4a13-b88a-ee945fb5dcb3 (40c360c7-0a64-4a13-b88a-ee945fb5dcb3): created successfully
Jun 26 06:03:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f478da-c754-4657-abe7-e6729756bb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:00 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Flow 'volume_create_manager' (d85068e3-5b7b-4662-a3b1-6d0cdefb76c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:03:00 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-9e47e008-c4f1-47f1-b0de-37df41d0e308 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Created volume successfully.
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Flow 'volume_create_manager' (749a6ecf-abea-4e67-8f9d-4eb0870bf921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ca5211-b92e-4f3f-985d-d9d129c9ef94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ca5211-b92e-4f3f-985d-d9d129c9ef94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-190218390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc19907c-03bb-43f1-9e28-90a81cda6c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed0bd19ab46493da4fee760ed469e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:03:02Z,use_quota=True,user_id='398e5a720cc3496c9e6f3f6e08d9e1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034629c5-0faa-4be0-afbe-ed0807e35aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034629c5-0faa-4be0-afbe-ed0807e35aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae77946-ccc3-4a07-8b37-f0010735da32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae77946-ccc3-4a07-8b37-f0010735da32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc19907c-03bb-43f1-9e28-90a81cda6c40', 'volume_name': 'volume-fc19907c-03bb-43f1-9e28-90a81cda6c40', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2adff08e-13d1-4567-945e-68e8ed8ce889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2adff08e-13d1-4567-945e-68e8ed8ce889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79acc395-61bf-408b-86a0-01648a78e899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:01 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Volume fc19907c-03bb-43f1-9e28-90a81cda6c40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc19907c-03bb-43f1-9e28-90a81cda6c40', 'volume_size': 1}
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-190218390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc19907c-03bb-43f1-9e28-90a81cda6c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed0bd19ab46493da4fee760ed469e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:03:02Z,use_quota=True,user_id='398e5a720cc3496c9e6f3f6e08d9e1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Creating volume fc19907c-03bb-43f1-9e28-90a81cda6c40 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:03:01 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:03:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fc19907c-03bb-43f1-9e28-90a81cda6c40 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:01 devstack sudo[113942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fc19907c-03bb-43f1-9e28-90a81cda6c40 1073741824
Jun 26 06:03:01 devstack sudo[113942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Flow 'volume_create_manager' (655617b2-ea40-4aa3-ae0e-9ffb6ac39816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a07583-89c3-4f3c-9800-03fbb7614584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a07583-89c3-4f3c-9800-03fbb7614584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1426750621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb80f66-ac80-41cb-b5b4-87aaff34de48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed0bd19ab46493da4fee760ed469e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:03:02Z,use_quota=True,user_id='398e5a720cc3496c9e6f3f6e08d9e1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fd35fd-ce6f-4f90-ae21-56eae4154c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fd35fd-ce6f-4f90-ae21-56eae4154c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5581a0-810a-43be-a98e-95805cea3ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5581a0-810a-43be-a98e-95805cea3ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeb80f66-ac80-41cb-b5b4-87aaff34de48', 'volume_name': 'volume-eeb80f66-ac80-41cb-b5b4-87aaff34de48', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba329794-8815-4ecd-8717-6814b50ef42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba329794-8815-4ecd-8717-6814b50ef42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc58fff4-74da-4f26-b93a-ea4a5b5aad76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:02 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Volume eeb80f66-ac80-41cb-b5b4-87aaff34de48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeb80f66-ac80-41cb-b5b4-87aaff34de48', 'volume_size': 1}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Flow 'volume_create_manager' (8c874cc5-279d-4a61-8359-2bc44ec9733e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec854693-508a-49cf-9bfe-187026151fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec854693-508a-49cf-9bfe-187026151fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1561745615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc06573-b852-4a74-b473-11df5edec5d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed0bd19ab46493da4fee760ed469e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:03:02Z,use_quota=True,user_id='398e5a720cc3496c9e6f3f6e08d9e1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf14d4b-4fe8-46e7-ab00-e5a2bc54bdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf14d4b-4fe8-46e7-ab00-e5a2bc54bdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18eff8ef-23b7-4090-9888-6b7b58cf3cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18eff8ef-23b7-4090-9888-6b7b58cf3cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc06573-b852-4a74-b473-11df5edec5d3', 'volume_name': 'volume-8dc06573-b852-4a74-b473-11df5edec5d3', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9de9fa1-63f3-439d-9e1b-ba7648cf1ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9de9fa1-63f3-439d-9e1b-ba7648cf1ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca5c7acb-2ea1-44c0-bfd0-dd3a6552920a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:02 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Volume 8dc06573-b852-4a74-b473-11df5edec5d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc06573-b852-4a74-b473-11df5edec5d3', 'volume_size': 1}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:02 devstack sudo[113942]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fc19907c-03bb-43f1-9e28-90a81cda6c40 1073741824" returned: 0 in 1.148s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fc19907c-03bb-43f1-9e28-90a81cda6c40 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:02 devstack sudo[113950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fc19907c-03bb-43f1-9e28-90a81cda6c40
Jun 26 06:03:02 devstack sudo[113950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Flow 'volume_create_manager' (a3d57127-12fe-4997-b18f-04f056f49f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe64d52-316c-44d9-8891-b0fea21fd731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe64d52-316c-44d9-8891-b0fea21fd731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-991001706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5da88f-85d8-4229-ae6b-ba0bf25e2f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed0bd19ab46493da4fee760ed469e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:03:03Z,use_quota=True,user_id='398e5a720cc3496c9e6f3f6e08d9e1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f029d453-f46f-4ecd-883e-68ba80c26db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f029d453-f46f-4ecd-883e-68ba80c26db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0147b0-0418-49e4-b579-b6bed5c7809e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0147b0-0418-49e4-b579-b6bed5c7809e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef5da88f-85d8-4229-ae6b-ba0bf25e2f94', 'volume_name': 'volume-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f3c568-2580-4173-b5c3-84ac782dc732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f3c568-2580-4173-b5c3-84ac782dc732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405a3f6f-801a-4284-ae1d-99a7f59520af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:03 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Volume ef5da88f-85d8-4229-ae6b-ba0bf25e2f94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94', 'volume_size': 1}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Flow 'volume_create_manager' (a9dff4c1-2b35-4b55-836a-ab2ac60f08ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4325c35d-4155-42ac-b79d-db53df606c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4325c35d-4155-42ac-b79d-db53df606c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-820366059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28817ba3-dc11-42d6-9e53-bd9cfa0fac42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed0bd19ab46493da4fee760ed469e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:03:04Z,use_quota=True,user_id='398e5a720cc3496c9e6f3f6e08d9e1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851f27a3-621c-4512-be36-16cef48c957b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851f27a3-621c-4512-be36-16cef48c957b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f9fa73-3cea-4471-be94-ebbcc9e7ab28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f9fa73-3cea-4471-be94-ebbcc9e7ab28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28817ba3-dc11-42d6-9e53-bd9cfa0fac42', 'volume_name': 'volume-28817ba3-dc11-42d6-9e53-bd9cfa0fac42', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543dc1c9-00f1-4e81-8f1f-9a615ab5b0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543dc1c9-00f1-4e81-8f1f-9a615ab5b0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:03 devstack sudo[113950]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2f84ad-a8da-4559-9f55-2e7162be0df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:03 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Volume 28817ba3-dc11-42d6-9e53-bd9cfa0fac42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28817ba3-dc11-42d6-9e53-bd9cfa0fac42', 'volume_size': 1}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fc19907c-03bb-43f1-9e28-90a81cda6c40" returned: 0 in 0.803s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.571s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1426750621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb80f66-ac80-41cb-b5b4-87aaff34de48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed0bd19ab46493da4fee760ed469e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:03:02Z,use_quota=True,user_id='398e5a720cc3496c9e6f3f6e08d9e1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Creating volume eeb80f66-ac80-41cb-b5b4-87aaff34de48 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:03:03 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eeb80f66-ac80-41cb-b5b4-87aaff34de48 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79acc395-61bf-408b-86a0-01648a78e899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc19907c-03bb-43f1-9e28-90a81cda6c40', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b28c75-6846-408a-840a-6db56a4a0649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:03 devstack sudo[113953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eeb80f66-ac80-41cb-b5b4-87aaff34de48 1073741824
Jun 26 06:03:03 devstack sudo[113953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:03 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Volume volume-fc19907c-03bb-43f1-9e28-90a81cda6c40 (fc19907c-03bb-43f1-9e28-90a81cda6c40): created successfully
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b28c75-6846-408a-840a-6db56a4a0649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Flow 'volume_create_manager' (749a6ecf-abea-4e67-8f9d-4eb0870bf921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:03:03 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-33ff1edb-73fe-479e-b425-893aa5e9ca6c tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Created volume successfully.
Jun 26 06:03:04 devstack sudo[113953]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eeb80f66-ac80-41cb-b5b4-87aaff34de48 1073741824" returned: 0 in 0.924s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eeb80f66-ac80-41cb-b5b4-87aaff34de48 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:04 devstack sudo[113961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eeb80f66-ac80-41cb-b5b4-87aaff34de48
Jun 26 06:03:04 devstack sudo[113961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:05 devstack sudo[113961]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eeb80f66-ac80-41cb-b5b4-87aaff34de48" returned: 0 in 0.655s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.631s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1561745615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc06573-b852-4a74-b473-11df5edec5d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed0bd19ab46493da4fee760ed469e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:03:02Z,use_quota=True,user_id='398e5a720cc3496c9e6f3f6e08d9e1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Creating volume 8dc06573-b852-4a74-b473-11df5edec5d3 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:03:05 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8dc06573-b852-4a74-b473-11df5edec5d3 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc58fff4-74da-4f26-b93a-ea4a5b5aad76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeb80f66-ac80-41cb-b5b4-87aaff34de48', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:05 devstack sudo[113964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8dc06573-b852-4a74-b473-11df5edec5d3 1073741824
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2cc025-ae68-4297-b5bb-be885c853eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:05 devstack sudo[113964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:05 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Volume volume-eeb80f66-ac80-41cb-b5b4-87aaff34de48 (eeb80f66-ac80-41cb-b5b4-87aaff34de48): created successfully
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2cc025-ae68-4297-b5bb-be885c853eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Flow 'volume_create_manager' (655617b2-ea40-4aa3-ae0e-9ffb6ac39816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:03:05 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-3b9c4cbe-afdd-48f9-bc7c-eacd0bcc5168 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Created volume successfully.
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Flow 'volume_create_manager' (e250cab5-4d4e-4f60-b1d1-c9a7c0bd1aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607ca1da-c1db-43ef-b59b-017e69b5d1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607ca1da-c1db-43ef-b59b-017e69b5d1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1807632733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef384b60-83aa-43b5-a31a-f7809731985b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c616745ba7ba4f5c9ed0910b31a37914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:03:06Z,use_quota=True,user_id='4bb6660a46ee491cadf6a32fdb983b2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58aa50b7-6005-40a0-8574-7fbaede7e289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58aa50b7-6005-40a0-8574-7fbaede7e289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175779c0-cc38-432a-bd0a-efa370e3e51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175779c0-cc38-432a-bd0a-efa370e3e51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef384b60-83aa-43b5-a31a-f7809731985b', 'volume_name': 'volume-ef384b60-83aa-43b5-a31a-f7809731985b', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88db0582-7d7e-49a2-9986-b83ae686b2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88db0582-7d7e-49a2-9986-b83ae686b2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6935cb3-a6be-4fb9-b36c-8c013535bf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:05 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Volume ef384b60-83aa-43b5-a31a-f7809731985b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef384b60-83aa-43b5-a31a-f7809731985b', 'volume_size': 1}
Jun 26 06:03:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:06 devstack sudo[113964]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8dc06573-b852-4a74-b473-11df5edec5d3 1073741824" returned: 0 in 0.838s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8dc06573-b852-4a74-b473-11df5edec5d3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:06 devstack sudo[113970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8dc06573-b852-4a74-b473-11df5edec5d3
Jun 26 06:03:06 devstack sudo[113970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:06 devstack sudo[113970]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8dc06573-b852-4a74-b473-11df5edec5d3" returned: 0 in 0.633s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:03:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.727s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-991001706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5da88f-85d8-4229-ae6b-ba0bf25e2f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed0bd19ab46493da4fee760ed469e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:03:03Z,use_quota=True,user_id='398e5a720cc3496c9e6f3f6e08d9e1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:03:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Creating volume ef5da88f-85d8-4229-ae6b-ba0bf25e2f94 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:03:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:03:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:03:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:03:06 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:03:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:06 devstack sudo[113973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94 1073741824
Jun 26 06:03:06 devstack sudo[113973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:06 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca5c7acb-2ea1-44c0-bfd0-dd3a6552920a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc06573-b852-4a74-b473-11df5edec5d3', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:06 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e42aeb-c159-4248-bac0-ef027c592a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:06 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Volume volume-8dc06573-b852-4a74-b473-11df5edec5d3 (8dc06573-b852-4a74-b473-11df5edec5d3): created successfully
Jun 26 06:03:06 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e42aeb-c159-4248-bac0-ef027c592a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:06 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Flow 'volume_create_manager' (8c874cc5-279d-4a61-8359-2bc44ec9733e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:03:06 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-983d26a2-3b76-4ce4-a979-dedf4c35bd8e tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Created volume successfully.
Jun 26 06:03:07 devstack sudo[113973]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94 1073741824" returned: 0 in 0.806s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:07 devstack sudo[113979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94
Jun 26 06:03:07 devstack sudo[113979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:08 devstack sudo[113979]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94" returned: 0 in 0.645s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:08 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:03:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.656s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:08 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-820366059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28817ba3-dc11-42d6-9e53-bd9cfa0fac42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed0bd19ab46493da4fee760ed469e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:03:04Z,use_quota=True,user_id='398e5a720cc3496c9e6f3f6e08d9e1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:03:08 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Creating volume 28817ba3-dc11-42d6-9e53-bd9cfa0fac42 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:03:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:08 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:03:08 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:03:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:08 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:03:08 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:03:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-28817ba3-dc11-42d6-9e53-bd9cfa0fac42 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405a3f6f-801a-4284-ae1d-99a7f59520af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:08 devstack sudo[113982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-28817ba3-dc11-42d6-9e53-bd9cfa0fac42 1073741824
Jun 26 06:03:08 devstack sudo[113982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759cdcf2-43b6-40b8-92d7-c739ad9bb01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:08 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Volume volume-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94 (ef5da88f-85d8-4229-ae6b-ba0bf25e2f94): created successfully
Jun 26 06:03:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759cdcf2-43b6-40b8-92d7-c739ad9bb01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Flow 'volume_create_manager' (a3d57127-12fe-4997-b18f-04f056f49f5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:03:08 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-3b78f662-eb9d-4c87-ac68-b65a16b7cce2 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Created volume successfully.
Jun 26 06:03:09 devstack sudo[113982]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-28817ba3-dc11-42d6-9e53-bd9cfa0fac42 1073741824" returned: 0 in 0.810s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-28817ba3-dc11-42d6-9e53-bd9cfa0fac42 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:09 devstack sudo[113988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-28817ba3-dc11-42d6-9e53-bd9cfa0fac42
Jun 26 06:03:09 devstack sudo[113988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:09 devstack sudo[113988]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-28817ba3-dc11-42d6-9e53-bd9cfa0fac42" returned: 0 in 0.632s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:03:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.094s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1807632733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef384b60-83aa-43b5-a31a-f7809731985b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c616745ba7ba4f5c9ed0910b31a37914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:03:06Z,use_quota=True,user_id='4bb6660a46ee491cadf6a32fdb983b2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:03:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Creating volume ef384b60-83aa-43b5-a31a-f7809731985b {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:03:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:03:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:03:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:03:09 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:03:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:09 devstack sudo[113991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b 1073741824
Jun 26 06:03:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2f84ad-a8da-4559-9f55-2e7162be0df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28817ba3-dc11-42d6-9e53-bd9cfa0fac42', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:09 devstack sudo[113991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f5eeed2-18f4-43a0-adee-77a697fdd232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:09 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Volume volume-28817ba3-dc11-42d6-9e53-bd9cfa0fac42 (28817ba3-dc11-42d6-9e53-bd9cfa0fac42): created successfully
Jun 26 06:03:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f5eeed2-18f4-43a0-adee-77a697fdd232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Flow 'volume_create_manager' (a9dff4c1-2b35-4b55-836a-ab2ac60f08ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:03:09 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-6f2d33a0-828f-4053-ad65-9bf4dd8b7910 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Created volume successfully.
Jun 26 06:03:10 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-50211c14-123c-4902-914c-33881eafea61 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "cinder-28817ba3-dc11-42d6-9e53-bd9cfa0fac42-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:10 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-50211c14-123c-4902-914c-33881eafea61 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-28817ba3-dc11-42d6-9e53-bd9cfa0fac42-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:10 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-50211c14-123c-4902-914c-33881eafea61 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "cinder-quobyte-28817ba3-dc11-42d6-9e53-bd9cfa0fac42" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:10 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-50211c14-123c-4902-914c-33881eafea61 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-quobyte-28817ba3-dc11-42d6-9e53-bd9cfa0fac42" acquired by "delete_volume" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:10 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f97a75-ea52-431f-9c62-46de458a45fb]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:03:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-50211c14-123c-4902-914c-33881eafea61 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-28817ba3-dc11-42d6-9e53-bd9cfa0fac42 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:10 devstack sudo[113993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-28817ba3-dc11-42d6-9e53-bd9cfa0fac42
Jun 26 06:03:10 devstack sudo[113993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 06:03:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:03:10 devstack sudo[113991]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:03:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b 1073741824" returned: 0 in 0.833s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:10 devstack sudo[113998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:03:10 devstack sudo[113998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:10 devstack sudo[114000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b
Jun 26 06:03:10 devstack sudo[114000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:10 devstack sudo[113993]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-50211c14-123c-4902-914c-33881eafea61 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-28817ba3-dc11-42d6-9e53-bd9cfa0fac42" returned: 0 in 0.775s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-50211c14-123c-4902-914c-33881eafea61 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-28817ba3-dc11-42d6-9e53-bd9cfa0fac42 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:10 devstack sudo[114005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-28817ba3-dc11-42d6-9e53-bd9cfa0fac42
Jun 26 06:03:10 devstack sudo[114005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:11 devstack sudo[113998]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.709s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:11 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:03:11 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 06:03:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 28 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 06:03:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>, <Thread(tpool_thread_0, started daemon 124035494721216)>, <Thread(tpool_thread_1, started daemon 124035486328512)>, <Thread(tpool_thread_2, started daemon 124035477919424)>, <Thread(tpool_thread_3, started daemon 124035469510336)>, <Thread(tpool_thread_4, started daemon 124035461101248)>, <Thread(tpool_thread_5, started daemon 124035452692160)>, <Thread(tpool_thread_6, started daemon 124035444283072)>, <Thread(tpool_thread_7, started daemon 124035435873984)>, <Thread(tpool_thread_8, started daemon 124035427464896)>, <Thread(tpool_thread_9, started daemon 124035419055808)>, <Thread(tpool_thread_10, started daemon 124035410646720)>, <Thread(tpool_thread_11, started daemon 124035402237632)>, <Thread(tpool_thread_12, started daemon 124035393828544)>, <Thread(tpool_thread_13, started daemon 124035385419456)>, <Thread(tpool_thread_14, started daemon 124035377010368)>, <Thread(tpool_thread_15, started daemon 124035368601280)>, <Thread(tpool_thread_16, started daemon 124035360192192)>, <Thread(tpool_thread_17, started daemon 124035351783104)>, <Thread(tpool_thread_18, started daemon 124035343374016)>, <Thread(tpool_thread_19, started daemon 124035334964928)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 06:03:11 devstack sudo[114000]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b" returned: 0 in 0.687s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:03:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6935cb3-a6be-4fb9-b36c-8c013535bf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef384b60-83aa-43b5-a31a-f7809731985b', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4dd935-0bec-479a-acb9-6e9c40b6bfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:11 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Volume volume-ef384b60-83aa-43b5-a31a-f7809731985b (ef384b60-83aa-43b5-a31a-f7809731985b): created successfully
Jun 26 06:03:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4dd935-0bec-479a-acb9-6e9c40b6bfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Flow 'volume_create_manager' (e250cab5-4d4e-4f60-b1d1-c9a7c0bd1aa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:03:11 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-3bbc2800-f6e9-4907-9928-24141dc4fbc3 tempest-VolumeDependencyTests-2022906675 None] Created volume successfully.
Jun 26 06:03:11 devstack sudo[114005]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-50211c14-123c-4902-914c-33881eafea61 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-28817ba3-dc11-42d6-9e53-bd9cfa0fac42" returned: 0 in 0.646s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:11 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-50211c14-123c-4902-914c-33881eafea61 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-quobyte-28817ba3-dc11-42d6-9e53-bd9cfa0fac42" released by "delete_volume" :: held 1.463s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:11 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-50211c14-123c-4902-914c-33881eafea61 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Created reservations ['cbb0be62-6787-417a-ab78-776492103a71', '49d50fff-335f-4d70-bff7-ddd728c246b5', '60f8313a-4ac8-418b-bbd5-4e291edd4a5f', 'c0bf27e1-a15f-441f-b59a-4fc8d6442358'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:03:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-50211c14-123c-4902-914c-33881eafea61 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-50211c14-123c-4902-914c-33881eafea61 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-50211c14-123c-4902-914c-33881eafea61 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:03:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-50211c14-123c-4902-914c-33881eafea61 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:03:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-50211c14-123c-4902-914c-33881eafea61 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-50211c14-123c-4902-914c-33881eafea61 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:11 devstack sudo[114012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:03:11 devstack sudo[114012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e4357101-55e9-4b2f-a945-30cc247838e2 tempest-VolumeDependencyTests-2022906675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e4357101-55e9-4b2f-a945-30cc247838e2 tempest-VolumeDependencyTests-2022906675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:12 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-e4357101-55e9-4b2f-a945-30cc247838e2 tempest-VolumeDependencyTests-2022906675 None] Creating offline snapshot e68dc053-e116-4199-97ae-3688fda50b2c of volume ef384b60-83aa-43b5-a31a-f7809731985b {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 06:03:12 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e21fc25-f5d0-4c18-80e1-f5e4d589d6ab]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:03:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e4357101-55e9-4b2f-a945-30cc247838e2 tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:12 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-72b64d79-0e94-4b21-bab5-50bd7797aad3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "cinder-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:12 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-72b64d79-0e94-4b21-bab5-50bd7797aad3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:12 devstack sudo[114012]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-50211c14-123c-4902-914c-33881eafea61 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.641s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:12 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-50211c14-123c-4902-914c-33881eafea61 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:03:12 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-50211c14-123c-4902-914c-33881eafea61 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Deleted volume successfully.
Jun 26 06:03:12 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-72b64d79-0e94-4b21-bab5-50bd7797aad3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "cinder-quobyte-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:12 devstack sudo[114015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b
Jun 26 06:03:12 devstack sudo[114015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:12 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-50211c14-123c-4902-914c-33881eafea61 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-28817ba3-dc11-42d6-9e53-bd9cfa0fac42-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:12 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-72b64d79-0e94-4b21-bab5-50bd7797aad3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-quobyte-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94" acquired by "delete_volume" :: waited 0.026s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:12 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ea6ee9-22fd-4643-817c-9b0f9b69ab54]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:03:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-72b64d79-0e94-4b21-bab5-50bd7797aad3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:12 devstack sudo[114018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94
Jun 26 06:03:12 devstack sudo[114018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:13 devstack sudo[114015]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e4357101-55e9-4b2f-a945-30cc247838e2 tempest-VolumeDependencyTests-2022906675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b" returned: 0 in 0.809s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e4357101-55e9-4b2f-a945-30cc247838e2 tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:13 devstack sudo[114024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c 1G
Jun 26 06:03:13 devstack sudo[114024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:13 devstack sudo[114018]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-72b64d79-0e94-4b21-bab5-50bd7797aad3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94" returned: 0 in 0.777s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-72b64d79-0e94-4b21-bab5-50bd7797aad3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:13 devstack sudo[114028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94
Jun 26 06:03:13 devstack sudo[114028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:13 devstack sudo[114024]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e4357101-55e9-4b2f-a945-30cc247838e2 tempest-VolumeDependencyTests-2022906675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c 1G" returned: 0 in 0.796s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e4357101-55e9-4b2f-a945-30cc247838e2 tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef384b60-83aa-43b5-a31a-f7809731985b -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:13 devstack sudo[114034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef384b60-83aa-43b5-a31a-f7809731985b -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c
Jun 26 06:03:13 devstack sudo[114034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:13 devstack sudo[114028]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-72b64d79-0e94-4b21-bab5-50bd7797aad3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94" returned: 0 in 0.689s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:13 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-72b64d79-0e94-4b21-bab5-50bd7797aad3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-quobyte-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94" released by "delete_volume" :: held 1.516s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:13 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-72b64d79-0e94-4b21-bab5-50bd7797aad3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Created reservations ['41195686-6a12-4dbe-98df-857d3050ad65', 'a18479b5-3d89-450b-a70c-c96d73c5d915', '5c25d461-ccfe-475d-8a29-9f0a175bd3fb', '4045a65c-8684-4563-8ede-2322c47cc127'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:03:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-72b64d79-0e94-4b21-bab5-50bd7797aad3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-72b64d79-0e94-4b21-bab5-50bd7797aad3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-72b64d79-0e94-4b21-bab5-50bd7797aad3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:03:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-72b64d79-0e94-4b21-bab5-50bd7797aad3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:03:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-72b64d79-0e94-4b21-bab5-50bd7797aad3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-72b64d79-0e94-4b21-bab5-50bd7797aad3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:14 devstack sudo[114036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:03:14 devstack sudo[114036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-3785a942-621b-420f-a936-98f2d3af291d tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "cinder-8dc06573-b852-4a74-b473-11df5edec5d3-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-3785a942-621b-420f-a936-98f2d3af291d tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-8dc06573-b852-4a74-b473-11df5edec5d3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:14 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=96,cinder:UPDATE=121,cinder:INSERT=36,cinder:DELETE=12 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 06:03:14 devstack sudo[114034]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e4357101-55e9-4b2f-a945-30cc247838e2 tempest-VolumeDependencyTests-2022906675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef384b60-83aa-43b5-a31a-f7809731985b -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c" returned: 0 in 0.745s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:14 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-e4357101-55e9-4b2f-a945-30cc247838e2 tempest-VolumeDependencyTests-2022906675 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c is being set with open permissions: ugo+rw
Jun 26 06:03:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e4357101-55e9-4b2f-a945-30cc247838e2 tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:14 devstack sudo[114041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c
Jun 26 06:03:14 devstack sudo[114041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-3785a942-621b-420f-a936-98f2d3af291d tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "cinder-quobyte-8dc06573-b852-4a74-b473-11df5edec5d3" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-3785a942-621b-420f-a936-98f2d3af291d tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-quobyte-8dc06573-b852-4a74-b473-11df5edec5d3" acquired by "delete_volume" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:14 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2803ce-5da1-4172-9d74-99ad652e9d18]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:03:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3785a942-621b-420f-a936-98f2d3af291d tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8dc06573-b852-4a74-b473-11df5edec5d3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:14 devstack sudo[114036]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-72b64d79-0e94-4b21-bab5-50bd7797aad3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.683s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:14 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-72b64d79-0e94-4b21-bab5-50bd7797aad3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:03:14 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-72b64d79-0e94-4b21-bab5-50bd7797aad3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Deleted volume successfully.
Jun 26 06:03:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-72b64d79-0e94-4b21-bab5-50bd7797aad3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-ef5da88f-85d8-4229-ae6b-ba0bf25e2f94-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:14 devstack sudo[114045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8dc06573-b852-4a74-b473-11df5edec5d3
Jun 26 06:03:14 devstack sudo[114045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:15 devstack sudo[114041]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e4357101-55e9-4b2f-a945-30cc247838e2 tempest-VolumeDependencyTests-2022906675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c" returned: 0 in 0.658s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:15 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=137,cinder:SELECT=98,cinder:INSERT=31,cinder:DELETE=10 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 06:03:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e4357101-55e9-4b2f-a945-30cc247838e2 tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:15 devstack sudo[114049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.info
Jun 26 06:03:15 devstack sudo[114049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:15 devstack sudo[114045]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3785a942-621b-420f-a936-98f2d3af291d tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8dc06573-b852-4a74-b473-11df5edec5d3" returned: 0 in 0.775s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3785a942-621b-420f-a936-98f2d3af291d tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8dc06573-b852-4a74-b473-11df5edec5d3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:15 devstack sudo[114053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8dc06573-b852-4a74-b473-11df5edec5d3
Jun 26 06:03:15 devstack sudo[114053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:15 devstack sudo[114049]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e4357101-55e9-4b2f-a945-30cc247838e2 tempest-VolumeDependencyTests-2022906675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.info" returned: 0 in 0.668s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:15 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-e4357101-55e9-4b2f-a945-30cc247838e2 tempest-VolumeDependencyTests-2022906675 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.info is being set with open permissions: ugo+rw
Jun 26 06:03:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e4357101-55e9-4b2f-a945-30cc247838e2 tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:16 devstack sudo[114056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.info
Jun 26 06:03:16 devstack sudo[114056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:16 devstack sudo[114053]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3785a942-621b-420f-a936-98f2d3af291d tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-8dc06573-b852-4a74-b473-11df5edec5d3" returned: 0 in 0.658s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-3785a942-621b-420f-a936-98f2d3af291d tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-quobyte-8dc06573-b852-4a74-b473-11df5edec5d3" released by "delete_volume" :: held 1.479s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:16 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-3785a942-621b-420f-a936-98f2d3af291d tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Created reservations ['8451b136-5175-4d60-b3df-d731e314d3c3', '713e6eb1-4774-4910-b8a4-1599732af459', '8c4fb2e5-79bb-4ef5-8f73-893eb71bf4bc', '1b6e6574-728e-465e-9ad1-ec07aec20fc3'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:03:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3785a942-621b-420f-a936-98f2d3af291d tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3785a942-621b-420f-a936-98f2d3af291d tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3785a942-621b-420f-a936-98f2d3af291d tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:03:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3785a942-621b-420f-a936-98f2d3af291d tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:03:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3785a942-621b-420f-a936-98f2d3af291d tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3785a942-621b-420f-a936-98f2d3af291d tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:16 devstack sudo[114059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:03:16 devstack sudo[114059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:16 devstack sudo[114056]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e4357101-55e9-4b2f-a945-30cc247838e2 tempest-VolumeDependencyTests-2022906675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.info" returned: 0 in 0.640s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e4357101-55e9-4b2f-a945-30cc247838e2 tempest-VolumeDependencyTests-2022906675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.422s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:16 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e4357101-55e9-4b2f-a945-30cc247838e2 tempest-VolumeDependencyTests-2022906675 None] Create snapshot completed successfully
Jun 26 06:03:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-675d7a2a-e360-428b-afcf-d31a8901cd0f tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "cinder-eeb80f66-ac80-41cb-b5b4-87aaff34de48-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-675d7a2a-e360-428b-afcf-d31a8901cd0f tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-eeb80f66-ac80-41cb-b5b4-87aaff34de48-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-675d7a2a-e360-428b-afcf-d31a8901cd0f tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "cinder-quobyte-eeb80f66-ac80-41cb-b5b4-87aaff34de48" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-675d7a2a-e360-428b-afcf-d31a8901cd0f tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-quobyte-eeb80f66-ac80-41cb-b5b4-87aaff34de48" acquired by "delete_volume" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:16 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[95edada7-d009-406c-acd0-c35382a7b605]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:03:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-675d7a2a-e360-428b-afcf-d31a8901cd0f tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eeb80f66-ac80-41cb-b5b4-87aaff34de48 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:16 devstack sudo[114059]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3785a942-621b-420f-a936-98f2d3af291d tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.666s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:16 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-3785a942-621b-420f-a936-98f2d3af291d tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:03:16 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-3785a942-621b-420f-a936-98f2d3af291d tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Deleted volume successfully.
Jun 26 06:03:16 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-3785a942-621b-420f-a936-98f2d3af291d tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-8dc06573-b852-4a74-b473-11df5edec5d3-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:17 devstack sudo[114063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eeb80f66-ac80-41cb-b5b4-87aaff34de48
Jun 26 06:03:17 devstack sudo[114063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:17 devstack sudo[114063]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-675d7a2a-e360-428b-afcf-d31a8901cd0f tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eeb80f66-ac80-41cb-b5b4-87aaff34de48" returned: 0 in 0.761s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-675d7a2a-e360-428b-afcf-d31a8901cd0f tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eeb80f66-ac80-41cb-b5b4-87aaff34de48 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:17 devstack sudo[114068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eeb80f66-ac80-41cb-b5b4-87aaff34de48
Jun 26 06:03:17 devstack sudo[114068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:17 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:03:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Flow 'volume_create_manager' (9aa20019-a3be-4c1d-b3c3-b3fa0641dbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:03:17 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b23ef4f-b19b-40f2-a0f5-7d4360d2ac2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b23ef4f-b19b-40f2-a0f5-7d4360d2ac2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-996559159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a59bd622-8cd6-41af-895b-2d550c3e5263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c616745ba7ba4f5c9ed0910b31a37914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e68dc053-e116-4199-97ae-3688fda50b2c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:03:18Z,use_quota=True,user_id='4bb6660a46ee491cadf6a32fdb983b2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74bbc532-9bdc-42ee-9761-1d8ad1c7da5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74bbc532-9bdc-42ee-9761-1d8ad1c7da5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (172e77a9-49ca-41c8-850d-fbdc950ce57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (172e77a9-49ca-41c8-850d-fbdc950ce57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a59bd622-8cd6-41af-895b-2d550c3e5263', 'volume_name': 'volume-a59bd622-8cd6-41af-895b-2d550c3e5263', 'volume_size': 1, 'snapshot_id': 'e68dc053-e116-4199-97ae-3688fda50b2c'}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4853d950-77c0-44fd-997c-4412c565f23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4853d950-77c0-44fd-997c-4412c565f23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3308e700-6fc1-452f-bbfa-96405454fa0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:18 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Volume a59bd622-8cd6-41af-895b-2d550c3e5263: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a59bd622-8cd6-41af-895b-2d550c3e5263', 'volume_size': 1, 'snapshot_id': 'e68dc053-e116-4199-97ae-3688fda50b2c'}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Acquiring lock "cinder-quobyte-e68dc053-e116-4199-97ae-3688fda50b2c-a59bd622-8cd6-41af-895b-2d550c3e5263" by "_create_volume_from_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Lock "cinder-quobyte-e68dc053-e116-4199-97ae-3688fda50b2c-a59bd622-8cd6-41af-895b-2d550c3e5263" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Creating volume a59bd622-8cd6-41af-895b-2d550c3e5263 from snapshot e68dc053-e116-4199-97ae-3688fda50b2c {{(pid=93708) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Acquiring lock "cinder-quobyte-a59bd622-8cd6-41af-895b-2d550c3e5263" by "_copy_volume_from_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Lock "cinder-quobyte-a59bd622-8cd6-41af-895b-2d550c3e5263" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] snapshot: e68dc053-e116-4199-97ae-3688fda50b2c, volume: a59bd622-8cd6-41af-895b-2d550c3e5263,  {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19fdf19-7445-43d7-acf4-8260169b1e45]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:18 devstack sudo[114070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c
Jun 26 06:03:18 devstack sudo[114070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:18 devstack sudo[114068]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-675d7a2a-e360-428b-afcf-d31a8901cd0f tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eeb80f66-ac80-41cb-b5b4-87aaff34de48" returned: 0 in 0.695s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-675d7a2a-e360-428b-afcf-d31a8901cd0f tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-quobyte-eeb80f66-ac80-41cb-b5b4-87aaff34de48" released by "delete_volume" :: held 1.496s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-675d7a2a-e360-428b-afcf-d31a8901cd0f tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Created reservations ['d920a57a-8046-4aa2-89cc-a0661ea301c4', 'c316a6ed-ee43-4682-83fc-ccc8b5b17ed4', 'df5f4a97-4329-4d3e-af4e-47b377e1e52f', '63d0db5b-2e74-4708-8274-ce2f929c1a2f'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-675d7a2a-e360-428b-afcf-d31a8901cd0f tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-675d7a2a-e360-428b-afcf-d31a8901cd0f tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-675d7a2a-e360-428b-afcf-d31a8901cd0f tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-675d7a2a-e360-428b-afcf-d31a8901cd0f tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-675d7a2a-e360-428b-afcf-d31a8901cd0f tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-675d7a2a-e360-428b-afcf-d31a8901cd0f tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:18 devstack sudo[114073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:03:18 devstack sudo[114073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:18 devstack sudo[114070]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c" returned: 0 in 0.762s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef384b60-83aa-43b5-a31a-f7809731985b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Creating direct copy from snapshot {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bb6279-2574-4030-8bb7-3b649af08f8b]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:03:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e1fdf62c-7327-493c-a5e4-32a7b007f824 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "cinder-fc19907c-03bb-43f1-9e28-90a81cda6c40-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e1fdf62c-7327-493c-a5e4-32a7b007f824 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-fc19907c-03bb-43f1-9e28-90a81cda6c40-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:19 devstack sudo[114078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b
Jun 26 06:03:19 devstack sudo[114078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e1fdf62c-7327-493c-a5e4-32a7b007f824 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "cinder-quobyte-fc19907c-03bb-43f1-9e28-90a81cda6c40" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e1fdf62c-7327-493c-a5e4-32a7b007f824 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-quobyte-fc19907c-03bb-43f1-9e28-90a81cda6c40" acquired by "delete_volume" :: waited 0.015s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:19 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b00665-ee16-46ad-907b-99b17fbebbbf]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:03:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e1fdf62c-7327-493c-a5e4-32a7b007f824 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fc19907c-03bb-43f1-9e28-90a81cda6c40 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:19 devstack sudo[114073]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-675d7a2a-e360-428b-afcf-d31a8901cd0f tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.717s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:19 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-675d7a2a-e360-428b-afcf-d31a8901cd0f tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:03:19 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-675d7a2a-e360-428b-afcf-d31a8901cd0f tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Deleted volume successfully.
Jun 26 06:03:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-675d7a2a-e360-428b-afcf-d31a8901cd0f tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-eeb80f66-ac80-41cb-b5b4-87aaff34de48-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:19 devstack sudo[114081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fc19907c-03bb-43f1-9e28-90a81cda6c40
Jun 26 06:03:19 devstack sudo[114081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:19 devstack sudo[114078]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b" returned: 0 in 0.813s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:19 devstack cinder-volume[93708]: DEBUG cinder.utils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Path /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a59bd622-8cd6-41af-895b-2d550c3e5263 not found in is_blk_device check {{(pid=93708) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 06:03:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a59bd622-8cd6-41af-895b-2d550c3e5263 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:19 devstack sudo[114086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a59bd622-8cd6-41af-895b-2d550c3e5263
Jun 26 06:03:19 devstack sudo[114086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:19 devstack sudo[114081]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e1fdf62c-7327-493c-a5e4-32a7b007f824 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fc19907c-03bb-43f1-9e28-90a81cda6c40" returned: 0 in 0.821s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e1fdf62c-7327-493c-a5e4-32a7b007f824 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fc19907c-03bb-43f1-9e28-90a81cda6c40 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:19 devstack sudo[114091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fc19907c-03bb-43f1-9e28-90a81cda6c40
Jun 26 06:03:19 devstack sudo[114091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:20 devstack sudo[114091]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e1fdf62c-7327-493c-a5e4-32a7b007f824 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-fc19907c-03bb-43f1-9e28-90a81cda6c40" returned: 0 in 0.884s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:20 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e1fdf62c-7327-493c-a5e4-32a7b007f824 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-quobyte-fc19907c-03bb-43f1-9e28-90a81cda6c40" released by "delete_volume" :: held 1.788s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:21 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-e1fdf62c-7327-493c-a5e4-32a7b007f824 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Created reservations ['127c635e-afd2-476e-8d01-ab1b00d9c8b6', '38119777-dc45-4f24-951a-457508367b33', '8e2ee006-2707-451e-a208-20bcb3f78ddb', '0d304dbd-7bf3-499f-a455-a8012e553bff'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:03:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e1fdf62c-7327-493c-a5e4-32a7b007f824 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e1fdf62c-7327-493c-a5e4-32a7b007f824 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e1fdf62c-7327-493c-a5e4-32a7b007f824 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:03:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e1fdf62c-7327-493c-a5e4-32a7b007f824 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:03:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e1fdf62c-7327-493c-a5e4-32a7b007f824 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e1fdf62c-7327-493c-a5e4-32a7b007f824 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:21 devstack sudo[114105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:03:21 devstack sudo[114105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:21 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d5f3ada9-fef9-41e9-ac62-5bb3bb6a4ab3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "cinder-40c360c7-0a64-4a13-b88a-ee945fb5dcb3-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:21 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d5f3ada9-fef9-41e9-ac62-5bb3bb6a4ab3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-40c360c7-0a64-4a13-b88a-ee945fb5dcb3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:21 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d5f3ada9-fef9-41e9-ac62-5bb3bb6a4ab3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "cinder-quobyte-40c360c7-0a64-4a13-b88a-ee945fb5dcb3" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:21 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d5f3ada9-fef9-41e9-ac62-5bb3bb6a4ab3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-quobyte-40c360c7-0a64-4a13-b88a-ee945fb5dcb3" acquired by "delete_volume" :: waited 0.027s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:21 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[a635d2e5-8444-4a99-9806-27ffb731dea9]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:03:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d5f3ada9-fef9-41e9-ac62-5bb3bb6a4ab3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-40c360c7-0a64-4a13-b88a-ee945fb5dcb3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:21 devstack sudo[114107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-40c360c7-0a64-4a13-b88a-ee945fb5dcb3
Jun 26 06:03:21 devstack sudo[114107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:23 devstack sudo[114105]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e1fdf62c-7327-493c-a5e4-32a7b007f824 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.942s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:23 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-e1fdf62c-7327-493c-a5e4-32a7b007f824 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:03:23 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e1fdf62c-7327-493c-a5e4-32a7b007f824 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Deleted volume successfully.
Jun 26 06:03:23 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e1fdf62c-7327-493c-a5e4-32a7b007f824 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-fc19907c-03bb-43f1-9e28-90a81cda6c40-delete_volume" released by "delete_volume" :: held 4.225s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:23 devstack sudo[114107]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d5f3ada9-fef9-41e9-ac62-5bb3bb6a4ab3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-40c360c7-0a64-4a13-b88a-ee945fb5dcb3" returned: 0 in 1.945s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d5f3ada9-fef9-41e9-ac62-5bb3bb6a4ab3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-40c360c7-0a64-4a13-b88a-ee945fb5dcb3 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:23 devstack sudo[114115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-40c360c7-0a64-4a13-b88a-ee945fb5dcb3
Jun 26 06:03:23 devstack sudo[114115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:24 devstack sudo[114115]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d5f3ada9-fef9-41e9-ac62-5bb3bb6a4ab3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-40c360c7-0a64-4a13-b88a-ee945fb5dcb3" returned: 0 in 1.282s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:24 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d5f3ada9-fef9-41e9-ac62-5bb3bb6a4ab3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-quobyte-40c360c7-0a64-4a13-b88a-ee945fb5dcb3" released by "delete_volume" :: held 3.340s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:24 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-d5f3ada9-fef9-41e9-ac62-5bb3bb6a4ab3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Created reservations ['37d61419-3444-44a6-b504-329632078d23', 'e0f98110-dd13-44d8-bfa7-4f1ea8fe2198', '85e27175-2e54-4d18-8fbf-2029af9f97c6', '5ee80d4d-900d-4e1a-a446-345da05f0bb7'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:03:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d5f3ada9-fef9-41e9-ac62-5bb3bb6a4ab3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d5f3ada9-fef9-41e9-ac62-5bb3bb6a4ab3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:25 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3ada9-fef9-41e9-ac62-5bb3bb6a4ab3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:03:25 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3ada9-fef9-41e9-ac62-5bb3bb6a4ab3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:03:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d5f3ada9-fef9-41e9-ac62-5bb3bb6a4ab3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d5f3ada9-fef9-41e9-ac62-5bb3bb6a4ab3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:25 devstack sudo[114086]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a59bd622-8cd6-41af-895b-2d550c3e5263" returned: 0 in 5.255s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:25 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3bdf7d-9544-4be3-a57a-02b20972a165]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:03:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:25 devstack sudo[114118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:03:25 devstack sudo[114118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:25 devstack sudo[114120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b
Jun 26 06:03:25 devstack sudo[114120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:25 devstack sudo[114118]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d5f3ada9-fef9-41e9-ac62-5bb3bb6a4ab3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.723s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:25 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-d5f3ada9-fef9-41e9-ac62-5bb3bb6a4ab3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:03:25 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-d5f3ada9-fef9-41e9-ac62-5bb3bb6a4ab3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Deleted volume successfully.
Jun 26 06:03:25 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d5f3ada9-fef9-41e9-ac62-5bb3bb6a4ab3 tempest-CreateVolumesFromSourceVolumeTest-1432689062 None] Lock "cinder-40c360c7-0a64-4a13-b88a-ee945fb5dcb3-delete_volume" released by "delete_volume" :: held 4.333s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:25 devstack sudo[114120]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b" returned: 0 in 0.962s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:25 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Image conversion details: src /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b, size 1024.00 MB, duration 5.26 sec, destination /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a59bd622-8cd6-41af-895b-2d550c3e5263 {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 06:03:25 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Converted 1024.00 MB image at 194.76 MB/s
Jun 26 06:03:25 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a59bd622-8cd6-41af-895b-2d550c3e5263 is being set with open permissions: ugo+rw
Jun 26 06:03:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a59bd622-8cd6-41af-895b-2d550c3e5263 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:26 devstack sudo[114126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a59bd622-8cd6-41af-895b-2d550c3e5263
Jun 26 06:03:26 devstack sudo[114126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:26 devstack sudo[114126]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a59bd622-8cd6-41af-895b-2d550c3e5263" returned: 0 in 0.697s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:26 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Lock "cinder-quobyte-a59bd622-8cd6-41af-895b-2d550c3e5263" released by "_copy_volume_from_snapshot" :: held 8.605s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:26 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Lock "cinder-quobyte-e68dc053-e116-4199-97ae-3688fda50b2c-a59bd622-8cd6-41af-895b-2d550c3e5263" released by "_create_volume_from_snapshot" :: held 8.634s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.650s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3308e700-6fc1-452f-bbfa-96405454fa0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a59bd622-8cd6-41af-895b-2d550c3e5263', 'volume_size': 1, 'snapshot_id': 'e68dc053-e116-4199-97ae-3688fda50b2c'}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bc82337-8f7e-415e-aba8-61c8abc29471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:26 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Volume volume-a59bd622-8cd6-41af-895b-2d550c3e5263 (a59bd622-8cd6-41af-895b-2d550c3e5263): created successfully
Jun 26 06:03:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bc82337-8f7e-415e-aba8-61c8abc29471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Flow 'volume_create_manager' (9aa20019-a3be-4c1d-b3c3-b3fa0641dbab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:03:26 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-4eec1ab1-3800-4c8c-982c-34125720a892 tempest-VolumeDependencyTests-2022906675 None] Created volume successfully.
Jun 26 06:03:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] Acquiring lock "cinder-e68dc053-e116-4199-97ae-3688fda50b2c-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] Lock "cinder-e68dc053-e116-4199-97ae-3688fda50b2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] Acquiring lock "cinder-quobyte-ef384b60-83aa-43b5-a31a-f7809731985b" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] Lock "cinder-quobyte-ef384b60-83aa-43b5-a31a-f7809731985b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] Acquiring lock "cinder-quobyte-e68dc053-e116-4199-97ae-3688fda50b2c" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] Lock "cinder-quobyte-e68dc053-e116-4199-97ae-3688fda50b2c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] Deleting offline snapshot e68dc053-e116-4199-97ae-3688fda50b2c of volume ef384b60-83aa-43b5-a31a-f7809731985b {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 06:03:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] snapshot_file for this snap is: volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 06:03:27 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[002cb57d-8a2f-45d9-a0ea-1afd7da82a54]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:03:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:28 devstack sudo[114130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c
Jun 26 06:03:28 devstack sudo[114130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:28 devstack sudo[114130]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c" returned: 0 in 0.758s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef384b60-83aa-43b5-a31a-f7809731985b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 06:03:28 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f066bfc-520f-4382-b7ce-64cfd7106682]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:03:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:28 devstack sudo[114135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b
Jun 26 06:03:28 devstack sudo[114135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:29 devstack sudo[114135]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b" returned: 0 in 0.767s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:29 devstack sudo[114142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c
Jun 26 06:03:29 devstack sudo[114142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:30 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:03:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Flow 'volume_create_manager' (34151c78-879f-4986-8b61-f8658e4537f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:03:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f0c589-f210-4c76-9e41-369ff8ac7a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f0c589-f210-4c76-9e41-369ff8ac7a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6491269-fa44-4fe7-922d-a2a5ffae4d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16fc05e46234f25beaf41811f3fb198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:03:30Z,use_quota=True,user_id='be36ebc1342048d5880b39813532377b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:30 devstack sudo[114142]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b67bd7-2854-4c7b-b75a-ef664e87bb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b67bd7-2854-4c7b-b75a-ef664e87bb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1afca465-c793-4d74-88f5-8ad9d8db5cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:30 devstack cinder-volume[93708]: DEBUG cinder.image.glance [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Creating Keystone auth plugin from conf {{(pid=93708) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 26 06:03:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c" returned: 0 in 0.754s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:30 devstack sudo[114147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c
Jun 26 06:03:30 devstack sudo[114147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1afca465-c793-4d74-88f5-8ad9d8db5cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f6491269-fa44-4fe7-922d-a2a5ffae4d8c', 'volume_name': 'volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c', 'volume_size': 1, 'image_id': '130b008e-7d31-4010-abe7-b43f74348625', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/130b008e-7d31-4010-abe7-b43f74348625', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '66fb402f63e29e66cf156c799830c5ac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e16fc05e46234f25beaf41811f3fb198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '146fbaa096372d00a85df221c02689cb97a6a7a0ba1af96cee5bc2ff800b40e827b989006e6b47b7ee9c672df7c03fb6e6ccd3761b11dca2c24ace261c677d8a', 'id': '130b008e-7d31-4010-abe7-b43f74348625', 'created_at': datetime.datetime(2026, 6, 26, 4, 3, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 4, 3, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/130b008e-7d31-4010-abe7-b43f74348625/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf439b1580>}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f28d990-e614-4955-94c0-fc634adebb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f28d990-e614-4955-94c0-fc634adebb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a609281c-91c6-4bd0-8126-b206ddfb4061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:30 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Volume f6491269-fa44-4fe7-922d-a2a5ffae4d8c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c', 'volume_size': 1, 'image_id': '130b008e-7d31-4010-abe7-b43f74348625', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/130b008e-7d31-4010-abe7-b43f74348625', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '66fb402f63e29e66cf156c799830c5ac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e16fc05e46234f25beaf41811f3fb198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '146fbaa096372d00a85df221c02689cb97a6a7a0ba1af96cee5bc2ff800b40e827b989006e6b47b7ee9c672df7c03fb6e6ccd3761b11dca2c24ace261c677d8a', 'id': '130b008e-7d31-4010-abe7-b43f74348625', 'created_at': datetime.datetime(2026, 6, 26, 4, 3, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 4, 3, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/130b008e-7d31-4010-abe7-b43f74348625/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf439b1580>}
Jun 26 06:03:30 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Trying to clone f6491269-fa44-4fe7-922d-a2a5ffae4d8c from image 130b008e-7d31-4010-abe7-b43f74348625 at location (None, [{'url': 'file:///opt/stack/data/glance/images/130b008e-7d31-4010-abe7-b43f74348625', 'metadata': {}}]). {{(pid=93708) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 26 06:03:30 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 26 06:03:30 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Image download 0.00 MB at 0.00 MB/s
Jun 26 06:03:30 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa84914-79ac-4a22-9842-12bf838053ef]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:03:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:30 devstack sudo[114149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD
Jun 26 06:03:30 devstack sudo[114149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:30 devstack sudo[114147]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b.e68dc053-e116-4199-97ae-3688fda50b2c" returned: 0 in 0.664s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] Lock "cinder-quobyte-e68dc053-e116-4199-97ae-3688fda50b2c" released by "_delete_snapshot" :: held 3.049s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] Lock "cinder-quobyte-ef384b60-83aa-43b5-a31a-f7809731985b" released by "delete_snapshot" :: held 3.079s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:31 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] Created reservations ['325fac0d-398f-43a1-a9a0-3a5a1ae087a2', 'd6349fc0-f89d-4870-aea1-93c41d9cbed2', 'ab3577fa-536b-4536-b63f-e0cb77a98202', 'f6162912-8c1d-4f35-b1d4-eb67489101fb'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:03:31 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] Delete snapshot completed successfully.
Jun 26 06:03:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ce402f30-7f56-40cc-96aa-71a491d81e3f tempest-VolumeDependencyTests-2022906675 None] Lock "cinder-e68dc053-e116-4199-97ae-3688fda50b2c-delete_snapshot" released by "delete_snapshot" :: held 3.233s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:31 devstack sudo[114149]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD" returned: 0 in 0.728s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:31 devstack sudo[114154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD
Jun 26 06:03:31 devstack sudo[114154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4d807b7c-51b8-44e5-bce6-db1041fb1c0a tempest-VolumeDependencyTests-2022906675 None] Acquiring lock "cinder-ef384b60-83aa-43b5-a31a-f7809731985b-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4d807b7c-51b8-44e5-bce6-db1041fb1c0a tempest-VolumeDependencyTests-2022906675 None] Lock "cinder-ef384b60-83aa-43b5-a31a-f7809731985b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4d807b7c-51b8-44e5-bce6-db1041fb1c0a tempest-VolumeDependencyTests-2022906675 None] Acquiring lock "cinder-quobyte-ef384b60-83aa-43b5-a31a-f7809731985b" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:32 devstack sudo[114154]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD" returned: 1 in 0.724s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:03:32 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Temporary image 130b008e-7d31-4010-abe7-b43f74348625 is fetched for user be36ebc1342048d5880b39813532377b. {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 26 06:03:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4d807b7c-51b8-44e5-bce6-db1041fb1c0a tempest-VolumeDependencyTests-2022906675 None] Lock "cinder-quobyte-ef384b60-83aa-43b5-a31a-f7809731985b" acquired by "delete_volume" :: waited 0.027s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:32 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[070884c1-b772-4dd1-83cb-c98fd01fb068]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:03:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4d807b7c-51b8-44e5-bce6-db1041fb1c0a tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:32 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7807114-fd0e-43bc-aaab-a92ec817a0fd]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:03:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:32 devstack sudo[114193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b
Jun 26 06:03:32 devstack sudo[114193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:32 devstack sudo[114194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD
Jun 26 06:03:32 devstack sudo[114194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:33 devstack sudo[114193]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4d807b7c-51b8-44e5-bce6-db1041fb1c0a tempest-VolumeDependencyTests-2022906675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b" returned: 0 in 0.794s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4d807b7c-51b8-44e5-bce6-db1041fb1c0a tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:33 devstack sudo[114194]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD" returned: 0 in 0.728s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:33 devstack sudo[114205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b
Jun 26 06:03:33 devstack sudo[114205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:33 devstack sudo[114207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD
Jun 26 06:03:33 devstack sudo[114207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:33 devstack sudo[114205]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4d807b7c-51b8-44e5-bce6-db1041fb1c0a tempest-VolumeDependencyTests-2022906675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ef384b60-83aa-43b5-a31a-f7809731985b" returned: 0 in 0.681s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4d807b7c-51b8-44e5-bce6-db1041fb1c0a tempest-VolumeDependencyTests-2022906675 None] Lock "cinder-quobyte-ef384b60-83aa-43b5-a31a-f7809731985b" released by "delete_volume" :: held 1.537s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-4d807b7c-51b8-44e5-bce6-db1041fb1c0a tempest-VolumeDependencyTests-2022906675 None] Created reservations ['e6f09639-d281-4dc8-8359-f92ebe2c7e04', 'c4f44074-54f7-4fac-93b2-3f6837855fb9', '1db258c1-bc73-47a5-b731-fdc84dca1825', '0ae5718f-ddc7-41ae-96d6-3711ce6f18fc'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:03:33 devstack sudo[114207]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD" returned: 1 in 0.744s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6491269-fa44-4fe7-922d-a2a5ffae4d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16fc05e46234f25beaf41811f3fb198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:03:30Z,use_quota=True,user_id='be36ebc1342048d5880b39813532377b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Creating volume f6491269-fa44-4fe7-922d-a2a5ffae4d8c {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:03:33 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:33 devstack sudo[114213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c 1073741824
Jun 26 06:03:33 devstack sudo[114213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4d807b7c-51b8-44e5-bce6-db1041fb1c0a tempest-VolumeDependencyTests-2022906675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4d807b7c-51b8-44e5-bce6-db1041fb1c0a tempest-VolumeDependencyTests-2022906675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4d807b7c-51b8-44e5-bce6-db1041fb1c0a tempest-VolumeDependencyTests-2022906675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4d807b7c-51b8-44e5-bce6-db1041fb1c0a tempest-VolumeDependencyTests-2022906675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4d807b7c-51b8-44e5-bce6-db1041fb1c0a tempest-VolumeDependencyTests-2022906675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4d807b7c-51b8-44e5-bce6-db1041fb1c0a tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:33 devstack sudo[114215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:03:33 devstack sudo[114215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6c369d51-43fd-4939-936b-b91985efd355 tempest-VolumeDependencyTests-2022906675 None] Acquiring lock "cinder-a59bd622-8cd6-41af-895b-2d550c3e5263-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6c369d51-43fd-4939-936b-b91985efd355 tempest-VolumeDependencyTests-2022906675 None] Lock "cinder-a59bd622-8cd6-41af-895b-2d550c3e5263-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6c369d51-43fd-4939-936b-b91985efd355 tempest-VolumeDependencyTests-2022906675 None] Acquiring lock "cinder-quobyte-a59bd622-8cd6-41af-895b-2d550c3e5263" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6c369d51-43fd-4939-936b-b91985efd355 tempest-VolumeDependencyTests-2022906675 None] Lock "cinder-quobyte-a59bd622-8cd6-41af-895b-2d550c3e5263" acquired by "delete_volume" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:34 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bcc911-7437-44bb-9eea-eab8eff9875d]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:03:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6c369d51-43fd-4939-936b-b91985efd355 tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a59bd622-8cd6-41af-895b-2d550c3e5263 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:34 devstack sudo[114215]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4d807b7c-51b8-44e5-bce6-db1041fb1c0a tempest-VolumeDependencyTests-2022906675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.711s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:34 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-4d807b7c-51b8-44e5-bce6-db1041fb1c0a tempest-VolumeDependencyTests-2022906675 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:03:34 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-4d807b7c-51b8-44e5-bce6-db1041fb1c0a tempest-VolumeDependencyTests-2022906675 None] Deleted volume successfully.
Jun 26 06:03:34 devstack sudo[114221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a59bd622-8cd6-41af-895b-2d550c3e5263
Jun 26 06:03:34 devstack sudo[114221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:34 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4d807b7c-51b8-44e5-bce6-db1041fb1c0a tempest-VolumeDependencyTests-2022906675 None] Lock "cinder-ef384b60-83aa-43b5-a31a-f7809731985b-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:34 devstack sudo[114213]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c 1073741824" returned: 0 in 0.910s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:34 devstack sudo[114224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c
Jun 26 06:03:34 devstack sudo[114224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:35 devstack sudo[114221]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6c369d51-43fd-4939-936b-b91985efd355 tempest-VolumeDependencyTests-2022906675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a59bd622-8cd6-41af-895b-2d550c3e5263" returned: 0 in 0.770s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6c369d51-43fd-4939-936b-b91985efd355 tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a59bd622-8cd6-41af-895b-2d550c3e5263 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:35 devstack sudo[114229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a59bd622-8cd6-41af-895b-2d550c3e5263
Jun 26 06:03:35 devstack sudo[114229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:35 devstack sudo[114224]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c" returned: 0 in 0.671s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:35 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:03:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:35 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Attempting download of 130b008e-7d31-4010-abe7-b43f74348625 ((None, [{'url': 'file:///opt/stack/data/glance/images/130b008e-7d31-4010-abe7-b43f74348625', 'metadata': {}}])) to volume f6491269-fa44-4fe7-922d-a2a5ffae4d8c. {{(pid=93708) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 26 06:03:35 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[3268908e-259b-49dc-8e9a-bce5bbec5d6a]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:03:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_130b008e-7d31-4010-abe7-b43f74348625_fyva8e30 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:35 devstack sudo[114232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_130b008e-7d31-4010-abe7-b43f74348625_fyva8e30
Jun 26 06:03:35 devstack sudo[114232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:35 devstack sudo[114229]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6c369d51-43fd-4939-936b-b91985efd355 tempest-VolumeDependencyTests-2022906675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-a59bd622-8cd6-41af-895b-2d550c3e5263" returned: 0 in 0.686s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6c369d51-43fd-4939-936b-b91985efd355 tempest-VolumeDependencyTests-2022906675 None] Lock "cinder-quobyte-a59bd622-8cd6-41af-895b-2d550c3e5263" released by "delete_volume" :: held 1.497s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:35 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-6c369d51-43fd-4939-936b-b91985efd355 tempest-VolumeDependencyTests-2022906675 None] Created reservations ['348646c0-e46a-4f67-b944-969469bb6b63', 'b67e8bfc-6d66-4fdb-bce1-62387f217881', 'b49243d8-20cb-4d63-8dfe-dbf4e30cdc05', '7156d122-8319-4edc-adbd-e73aa77a63da'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:03:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6c369d51-43fd-4939-936b-b91985efd355 tempest-VolumeDependencyTests-2022906675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6c369d51-43fd-4939-936b-b91985efd355 tempest-VolumeDependencyTests-2022906675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6c369d51-43fd-4939-936b-b91985efd355 tempest-VolumeDependencyTests-2022906675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:03:36 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6c369d51-43fd-4939-936b-b91985efd355 tempest-VolumeDependencyTests-2022906675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:03:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6c369d51-43fd-4939-936b-b91985efd355 tempest-VolumeDependencyTests-2022906675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6c369d51-43fd-4939-936b-b91985efd355 tempest-VolumeDependencyTests-2022906675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:36 devstack sudo[114235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:03:36 devstack sudo[114235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:36 devstack sudo[114232]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_130b008e-7d31-4010-abe7-b43f74348625_fyva8e30" returned: 0 in 0.719s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_130b008e-7d31-4010-abe7-b43f74348625_fyva8e30 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:36 devstack sudo[114239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_130b008e-7d31-4010-abe7-b43f74348625_fyva8e30
Jun 26 06:03:36 devstack sudo[114239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:36 devstack sudo[114235]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6c369d51-43fd-4939-936b-b91985efd355 tempest-VolumeDependencyTests-2022906675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.667s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:36 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-6c369d51-43fd-4939-936b-b91985efd355 tempest-VolumeDependencyTests-2022906675 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:03:36 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-6c369d51-43fd-4939-936b-b91985efd355 tempest-VolumeDependencyTests-2022906675 None] Deleted volume successfully.
Jun 26 06:03:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-6c369d51-43fd-4939-936b-b91985efd355 tempest-VolumeDependencyTests-2022906675 None] Lock "cinder-a59bd622-8cd6-41af-895b-2d550c3e5263-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:36 devstack sudo[114239]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_130b008e-7d31-4010-abe7-b43f74348625_fyva8e30" returned: 1 in 0.748s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_130b008e-7d31-4010-abe7-b43f74348625_fyva8e30' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:03:36 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bef822-64c6-4f4d-8526-361a5c2de130]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:03:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:37 devstack sudo[114244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD
Jun 26 06:03:37 devstack sudo[114244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:37 devstack sudo[114244]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD" returned: 0 in 0.753s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:37 devstack sudo[114248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD
Jun 26 06:03:37 devstack sudo[114248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:38 devstack sudo[114248]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD" returned: 1 in 0.754s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:03:38 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] 130b008e-7d31-4010-abe7-b43f74348625 was raw, converting to raw {{(pid=93708) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 26 06:03:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:38 devstack sudo[114253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c
Jun 26 06:03:38 devstack sudo[114253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:39 devstack sudo[114253]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c" returned: 0 in 0.724s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:39 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_130b008e-7d31-4010-abe7-b43f74348625_2twjql95devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 06:03:39 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Converted 0.00 MB image at 0.00 MB/s
Jun 26 06:03:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:39 devstack sudo[114258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c 1G
Jun 26 06:03:39 devstack sudo[114258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:39 devstack sudo[114258]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c 1G" returned: 0 in 0.672s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:39 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[1757ecd2-cd38-41f2-8b74-8a84f0e8c664]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:03:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:40 devstack sudo[114263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c
Jun 26 06:03:40 devstack sudo[114263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:40 devstack sudo[114263]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c" returned: 0 in 0.721s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:40 devstack sudo[114267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c
Jun 26 06:03:40 devstack sudo[114267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:41 devstack sudo[114267]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c" returned: 1 in 0.737s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:03:41 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Downloaded image 130b008e-7d31-4010-abe7-b43f74348625 ((None, [{'url': 'file:///opt/stack/data/glance/images/130b008e-7d31-4010-abe7-b43f74348625', 'metadata': {}}])) to volume f6491269-fa44-4fe7-922d-a2a5ffae4d8c successfully. {{(pid=93708) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 26 06:03:41 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Temporary image 130b008e-7d31-4010-abe7-b43f74348625 for user be36ebc1342048d5880b39813532377b is deleted. {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 26 06:03:41 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Marking volume f6491269-fa44-4fe7-922d-a2a5ffae4d8c as bootable. {{(pid=93708) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 26 06:03:41 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Copying metadata from image 130b008e-7d31-4010-abe7-b43f74348625 to f6491269-fa44-4fe7-922d-a2a5ffae4d8c. {{(pid=93708) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 26 06:03:41 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Creating volume glance metadata for volume f6491269-fa44-4fe7-922d-a2a5ffae4d8c backed by image 130b008e-7d31-4010-abe7-b43f74348625 with: {'image_id': '130b008e-7d31-4010-abe7-b43f74348625', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '66fb402f63e29e66cf156c799830c5ac', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93708) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 26 06:03:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a609281c-91c6-4bd0-8126-b206ddfb4061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c', 'volume_size': 1, 'image_id': '130b008e-7d31-4010-abe7-b43f74348625', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/130b008e-7d31-4010-abe7-b43f74348625', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '66fb402f63e29e66cf156c799830c5ac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e16fc05e46234f25beaf41811f3fb198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '146fbaa096372d00a85df221c02689cb97a6a7a0ba1af96cee5bc2ff800b40e827b989006e6b47b7ee9c672df7c03fb6e6ccd3761b11dca2c24ace261c677d8a', 'id': '130b008e-7d31-4010-abe7-b43f74348625', 'created_at': datetime.datetime(2026, 6, 26, 4, 3, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 4, 3, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/130b008e-7d31-4010-abe7-b43f74348625/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf439b1580>}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea17ec6-8069-40b9-94be-c800db37e8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:41 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Volume volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c (f6491269-fa44-4fe7-922d-a2a5ffae4d8c): created successfully
Jun 26 06:03:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea17ec6-8069-40b9-94be-c800db37e8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Flow 'volume_create_manager' (34151c78-879f-4986-8b61-f8658e4537f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:03:41 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-b33fcceb-2b7c-4e7f-8dbf-81de9bcfb735 tempest-VolumeImageDependencyTests-288115251 None] Created volume successfully.
Jun 26 06:03:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] Acquiring lock "cinder-f6491269-fa44-4fe7-922d-a2a5ffae4d8c-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] Lock "cinder-f6491269-fa44-4fe7-922d-a2a5ffae4d8c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] Acquiring lock "cinder-quobyte-f6491269-fa44-4fe7-922d-a2a5ffae4d8c" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:03:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] Lock "cinder-quobyte-f6491269-fa44-4fe7-922d-a2a5ffae4d8c" acquired by "delete_volume" :: waited 0.015s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:03:41 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[28195be2-a9db-4eb3-85fc-7fe0968754f9]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:03:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:42 devstack sudo[114272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c
Jun 26 06:03:42 devstack sudo[114272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:42 devstack sudo[114272]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c" returned: 0 in 0.742s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:42 devstack sudo[114277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c
Jun 26 06:03:42 devstack sudo[114277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:43 devstack sudo[114277]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c" returned: 1 in 0.748s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:03:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:43 devstack sudo[114282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c
Jun 26 06:03:43 devstack sudo[114282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:44 devstack sudo[114282]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-f6491269-fa44-4fe7-922d-a2a5ffae4d8c" returned: 0 in 0.633s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] Lock "cinder-quobyte-f6491269-fa44-4fe7-922d-a2a5ffae4d8c" released by "delete_volume" :: held 2.183s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:44 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] Created reservations ['d76142b3-bef0-408f-a424-90dc6ace2a50', '851f56ea-23ff-4eb7-bbbb-edb40e04ab9e', 'b3884ae1-dc05-46ad-af55-70ec74339326', '26dde14f-bf12-45a5-ae2c-b23f4faa4b33'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:03:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:03:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:03:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:44 devstack sudo[114285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:03:44 devstack sudo[114285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:44 devstack sudo[114285]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.637s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:44 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:03:44 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] Deleted volume successfully.
Jun 26 06:03:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-cb333433-37c5-4b13-b07a-ac7c2ca37985 tempest-VolumeImageDependencyTests-288115251 None] Lock "cinder-f6491269-fa44-4fe7-922d-a2a5ffae4d8c-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:03:54 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=45,cinder:INSERT=23,cinder:UPDATE=70,cinder:DELETE=3 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 06:03:54 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:DELETE=8,cinder:SELECT=58,cinder:UPDATE=67,cinder:INSERT=20 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Flow 'volume_create_manager' (78306f85-1f59-4ad1-a2ad-d75891819212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (754809d3-e575-48f6-942e-c6c95f333695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (754809d3-e575-48f6-942e-c6c95f333695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1665698240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d0ec88-3615-4011-89e8-e8ba8e4e0023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9cd0e7f89b54891860894ac5e76c5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:03:57Z,use_quota=True,user_id='ead2fc55d161415c8b6d7342ffc56d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df024b49-db09-4847-a1f1-e2396b7646d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df024b49-db09-4847-a1f1-e2396b7646d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f708a185-67bf-4976-8002-6aa899e654fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f708a185-67bf-4976-8002-6aa899e654fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d0ec88-3615-4011-89e8-e8ba8e4e0023', 'volume_name': 'volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d75533c-4d9f-449a-afe2-ae5da5b71f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d75533c-4d9f-449a-afe2-ae5da5b71f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c3317c-276d-457f-8825-a2d81f03c70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:57 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Volume b4d0ec88-3615-4011-89e8-e8ba8e4e0023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023', 'volume_size': 1}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1665698240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d0ec88-3615-4011-89e8-e8ba8e4e0023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9cd0e7f89b54891860894ac5e76c5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:03:57Z,use_quota=True,user_id='ead2fc55d161415c8b6d7342ffc56d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Creating volume b4d0ec88-3615-4011-89e8-e8ba8e4e0023 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:03:57 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:57 devstack sudo[114328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023 1073741824
Jun 26 06:03:57 devstack sudo[114328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Flow 'volume_create_manager' (ee154b4f-833b-47ea-aa71-8782cf4743e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e10a72b-ff74-4526-886b-9a99b4d1469c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e10a72b-ff74-4526-886b-9a99b4d1469c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1856696291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ab7d9e-4928-4c21-8fa4-17b5cbfa8513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceed338e169f41e69b4c5ba813d10246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:03:58Z,use_quota=True,user_id='3dac6e065b394e6787873d0576559e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c82071-f16f-42a4-bc33-6e6c3f94bceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c82071-f16f-42a4-bc33-6e6c3f94bceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4355d47-f7db-476f-81a9-bd80c6a97a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4355d47-f7db-476f-81a9-bd80c6a97a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88ab7d9e-4928-4c21-8fa4-17b5cbfa8513', 'volume_name': 'volume-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9600fe6d-3e56-4ec2-bf28-bd5ba64268fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9600fe6d-3e56-4ec2-bf28-bd5ba64268fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2796c59e-31d8-4e5f-86f2-e622f4d18d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:57 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Volume 88ab7d9e-4928-4c21-8fa4-17b5cbfa8513: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513', 'volume_size': 1}
Jun 26 06:03:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:58 devstack sudo[114328]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023 1073741824" returned: 0 in 1.058s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:58 devstack sudo[114334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023
Jun 26 06:03:58 devstack sudo[114334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:59 devstack sudo[114334]: pam_unix(sudo:session): session closed for user root
Jun 26 06:03:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023" returned: 0 in 0.710s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:03:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:03:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.539s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1856696291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ab7d9e-4928-4c21-8fa4-17b5cbfa8513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceed338e169f41e69b4c5ba813d10246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:03:58Z,use_quota=True,user_id='3dac6e065b394e6787873d0576559e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:03:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Creating volume 88ab7d9e-4928-4c21-8fa4-17b5cbfa8513 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:03:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:03:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:03:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:03:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:03:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:03:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:03:59 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:03:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:03:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c3317c-276d-457f-8825-a2d81f03c70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737940b5-2814-4a99-b0a4-c3260a617736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:03:59 devstack sudo[114337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513 1073741824
Jun 26 06:03:59 devstack sudo[114337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:03:59 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Volume volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023 (b4d0ec88-3615-4011-89e8-e8ba8e4e0023): created successfully
Jun 26 06:03:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737940b5-2814-4a99-b0a4-c3260a617736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:03:59 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Flow 'volume_create_manager' (78306f85-1f59-4ad1-a2ad-d75891819212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:03:59 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-380ac1f4-f891-4f20-bac1-af48d1154ff6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Created volume successfully.
Jun 26 06:04:00 devstack sudo[114337]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513 1073741824" returned: 0 in 0.953s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:00 devstack sudo[114343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513
Jun 26 06:04:00 devstack sudo[114343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a47b4425-2fad-48dd-8bf6-8f88d00e355e tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:01 devstack sudo[114343]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513" returned: 0 in 0.933s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a47b4425-2fad-48dd-8bf6-8f88d00e355e tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.460s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-a47b4425-2fad-48dd-8bf6-8f88d00e355e tempest-CreateVolumesFromSnapshotTest-1424569728 None] Creating offline snapshot d70fb768-24d6-48a6-bf11-974d8b94104d of volume b4d0ec88-3615-4011-89e8-e8ba8e4e0023 {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2796c59e-31d8-4e5f-86f2-e622f4d18d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d952b9-1ef8-4da0-b152-586add85bef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[214382e6-4c95-4ee3-89c0-94254462d7d2]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a47b4425-2fad-48dd-8bf6-8f88d00e355e tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:01 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Volume volume-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513 (88ab7d9e-4928-4c21-8fa4-17b5cbfa8513): created successfully
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d952b9-1ef8-4da0-b152-586add85bef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Flow 'volume_create_manager' (ee154b4f-833b-47ea-aa71-8782cf4743e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:01 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-8e8e2ad5-cf04-470b-bdad-f151ae719127 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Created volume successfully.
Jun 26 06:04:01 devstack sudo[114352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023
Jun 26 06:04:01 devstack sudo[114352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Flow 'volume_create_manager' (7e2b2756-be0b-4fbf-bad2-395a2b4ca31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d860ec6-0e98-4b53-9852-0517efe1cf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d860ec6-0e98-4b53-9852-0517efe1cf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86b6720b-d87f-4f87-92d9-5a4d7469f65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b68b52013fc42e683fd9b0e40f98990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:01Z,use_quota=True,user_id='c582d90c1df941a9a84234032a78878f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7046fe6d-bd93-49ae-8a91-794bd7adda80),volume_type_id=7046fe6d-bd93-49ae-8a91-794bd7adda80)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13212323-9c88-45c9-9a56-aeabfb0ace97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13212323-9c88-45c9-9a56-aeabfb0ace97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea20445e-f858-49fe-b4ca-63b1cfb11f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG cinder.image.glance [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Creating Keystone auth plugin from conf {{(pid=93708) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea20445e-f858-49fe-b4ca-63b1cfb11f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '86b6720b-d87f-4f87-92d9-5a4d7469f65e', 'volume_name': 'volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e', 'volume_size': 1, 'image_id': 'ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cbaf0aa0f6b322f5cb422f19a4fc491a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7b68b52013fc42e683fd9b0e40f98990', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a47d504173a6f98e9619098a4cd7c5416c9205932c0ff5dd7a09662e3d77295e6c62f10e32707249ef5400546b0aac9a259702154728f24689f993194dcddf8c', 'id': 'ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec', 'created_at': datetime.datetime(2026, 6, 26, 4, 3, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf43a7bb00>}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6f7d46-8e4f-49d6-be2a-f2503c8f7d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6f7d46-8e4f-49d6-be2a-f2503c8f7d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3c8ae0-4047-47c3-b6c3-52ab7ecfafa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:01 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Volume 86b6720b-d87f-4f87-92d9-5a4d7469f65e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e', 'volume_size': 1, 'image_id': 'ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cbaf0aa0f6b322f5cb422f19a4fc491a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7b68b52013fc42e683fd9b0e40f98990', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a47d504173a6f98e9619098a4cd7c5416c9205932c0ff5dd7a09662e3d77295e6c62f10e32707249ef5400546b0aac9a259702154728f24689f993194dcddf8c', 'id': 'ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec', 'created_at': datetime.datetime(2026, 6, 26, 4, 3, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf43a7bb00>}
Jun 26 06:04:01 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Trying to clone 86b6720b-d87f-4f87-92d9-5a4d7469f65e from image ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec at location (None, [{'url': 'file:///opt/stack/data/glance/images/ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec', 'metadata': {}}]). {{(pid=93708) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 26 06:04:02 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 26 06:04:02 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Image download 0.00 MB at 0.00 MB/s
Jun 26 06:04:02 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb73a5b-9388-4cbc-bea5-e5a816bf7e45]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:02 devstack sudo[114358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD
Jun 26 06:04:02 devstack sudo[114358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:02 devstack sudo[114352]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a47b4425-2fad-48dd-8bf6-8f88d00e355e tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023" returned: 0 in 1.081s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a47b4425-2fad-48dd-8bf6-8f88d00e355e tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.d70fb768-24d6-48a6-bf11-974d8b94104d 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:02 devstack sudo[114361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.d70fb768-24d6-48a6-bf11-974d8b94104d 1G
Jun 26 06:04:02 devstack sudo[114361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:02 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:04:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Flow 'volume_create_manager' (231cd4e3-5427-49a2-add8-553017110a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3223d87c-22b6-4276-80c4-4d0d4c54a982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3223d87c-22b6-4276-80c4-4d0d4c54a982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-344184919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=648b8a0c-c5a5-4c82-9967-eae5864f4a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceed338e169f41e69b4c5ba813d10246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:02Z,use_quota=True,user_id='3dac6e065b394e6787873d0576559e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac3db2b-291a-4bad-bea2-fb2455b00e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac3db2b-291a-4bad-bea2-fb2455b00e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd821b20-263d-46ab-8c29-0ebe5d731064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd821b20-263d-46ab-8c29-0ebe5d731064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '648b8a0c-c5a5-4c82-9967-eae5864f4a6b', 'volume_name': 'volume-648b8a0c-c5a5-4c82-9967-eae5864f4a6b', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3d633f-7a0a-4dee-b43c-fc84e2c78abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3d633f-7a0a-4dee-b43c-fc84e2c78abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:02 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8281ae8c-dcd3-4ec4-b5d5-4c13afdf24f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:02 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Volume 648b8a0c-c5a5-4c82-9967-eae5864f4a6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-648b8a0c-c5a5-4c82-9967-eae5864f4a6b', 'volume_size': 1}
Jun 26 06:04:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Flow 'volume_create_manager' (0a5c26cf-bf91-4c88-8598-ba2b282567df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f194a1d5-37f6-44eb-82ae-61f3b99fcb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f194a1d5-37f6-44eb-82ae-61f3b99fcb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1759664802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9fd526d-841c-4931-be44-a4a96122d28c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceed338e169f41e69b4c5ba813d10246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:03Z,use_quota=True,user_id='3dac6e065b394e6787873d0576559e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2bfac82-8fe3-4496-ba01-8b571f5a8241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2bfac82-8fe3-4496-ba01-8b571f5a8241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (997a26c9-fdbc-4e29-abd9-23972e3ceee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (997a26c9-fdbc-4e29-abd9-23972e3ceee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9fd526d-841c-4931-be44-a4a96122d28c', 'volume_name': 'volume-e9fd526d-841c-4931-be44-a4a96122d28c', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b79ab119-0c7a-4e63-9804-e6b1c81168b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b79ab119-0c7a-4e63-9804-e6b1c81168b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6649472-b5ae-465b-90c7-a445ed96e7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:03 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Volume e9fd526d-841c-4931-be44-a4a96122d28c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9fd526d-841c-4931-be44-a4a96122d28c', 'volume_size': 1}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:03 devstack sudo[114358]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD" returned: 0 in 1.487s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:03 devstack sudo[114369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD
Jun 26 06:04:03 devstack sudo[114369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:03 devstack sudo[114361]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Flow 'volume_create_manager' (b2ea5742-7be0-43d5-bfab-e7c4dcb32cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9fdd7e-63d2-4b1b-a404-882414b5e57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a47b4425-2fad-48dd-8bf6-8f88d00e355e tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.d70fb768-24d6-48a6-bf11-974d8b94104d 1G" returned: 0 in 1.454s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a47b4425-2fad-48dd-8bf6-8f88d00e355e tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.d70fb768-24d6-48a6-bf11-974d8b94104d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9fdd7e-63d2-4b1b-a404-882414b5e57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2014754324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c31f248-a4c6-4b3f-ac19-a624f2cfcafe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceed338e169f41e69b4c5ba813d10246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:04Z,use_quota=True,user_id='3dac6e065b394e6787873d0576559e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1cc22d2-c303-4e06-9ba7-94552531791b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:03 devstack sudo[114371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.d70fb768-24d6-48a6-bf11-974d8b94104d
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1cc22d2-c303-4e06-9ba7-94552531791b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:03 devstack sudo[114371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1567b50-9788-49c0-8469-f9d9c47ff7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1567b50-9788-49c0-8469-f9d9c47ff7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c31f248-a4c6-4b3f-ac19-a624f2cfcafe', 'volume_name': 'volume-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2467a2c0-8992-4dc7-a6f4-bf290f28c279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2467a2c0-8992-4dc7-a6f4-bf290f28c279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e7af8d-41d5-4e3e-8c8c-6a65b7b74661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:04 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Volume 4c31f248-a4c6-4b3f-ac19-a624f2cfcafe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe', 'volume_size': 1}
Jun 26 06:04:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:04 devstack sudo[114369]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD" returned: 1 in 0.834s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:04:04 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Temporary image ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec is fetched for user c582d90c1df941a9a84234032a78878f. {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 26 06:04:04 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cd1690-5ba1-4d94-bdbd-11dbc74f4a73]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:04 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:04:04 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Flow 'volume_create_manager' (93403d2a-eca6-4a9a-9019-c9136792dbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:04 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (004fa547-baee-45cc-8599-8f998d896ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:04 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (004fa547-baee-45cc-8599-8f998d896ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-708251968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da2ed347-c2f0-4432-aa42-57d56f3b0c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceed338e169f41e69b4c5ba813d10246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:05Z,use_quota=True,user_id='3dac6e065b394e6787873d0576559e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:04 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d551708a-bcfb-4584-9f5f-bc9b3f81136c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:04 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d551708a-bcfb-4584-9f5f-bc9b3f81136c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:04 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40247b9-b8ce-4920-9b42-1d45034e76e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:04 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40247b9-b8ce-4920-9b42-1d45034e76e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da2ed347-c2f0-4432-aa42-57d56f3b0c78', 'volume_name': 'volume-da2ed347-c2f0-4432-aa42-57d56f3b0c78', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:04 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d87e065-3549-4841-a4d8-f8a6fea52d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:04 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d87e065-3549-4841-a4d8-f8a6fea52d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:04 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b41440-d7ae-4d7b-8bb1-33139e6c0a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:04 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Volume da2ed347-c2f0-4432-aa42-57d56f3b0c78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da2ed347-c2f0-4432-aa42-57d56f3b0c78', 'volume_size': 1}
Jun 26 06:04:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:04 devstack sudo[114378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD
Jun 26 06:04:04 devstack sudo[114378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:05 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:04:05 devstack sudo[114371]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Flow 'volume_create_manager' (cd9f0c79-522a-4d72-a7bd-20c2faf186e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a6db855-6e38-447a-afcc-8d93473d003f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a47b4425-2fad-48dd-8bf6-8f88d00e355e tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.d70fb768-24d6-48a6-bf11-974d8b94104d" returned: 0 in 1.502s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:05 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-a47b4425-2fad-48dd-8bf6-8f88d00e355e tempest-CreateVolumesFromSnapshotTest-1424569728 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.d70fb768-24d6-48a6-bf11-974d8b94104d is being set with open permissions: ugo+rw
Jun 26 06:04:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a47b4425-2fad-48dd-8bf6-8f88d00e355e tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.d70fb768-24d6-48a6-bf11-974d8b94104d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a6db855-6e38-447a-afcc-8d93473d003f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1753116903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a1a786-a856-42ee-acb9-7f127f0a70fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceed338e169f41e69b4c5ba813d10246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:05Z,use_quota=True,user_id='3dac6e065b394e6787873d0576559e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9498205f-dfae-44af-986a-bf42ed7e596d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9498205f-dfae-44af-986a-bf42ed7e596d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:05 devstack sudo[114384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.d70fb768-24d6-48a6-bf11-974d8b94104d
Jun 26 06:04:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (261b2f94-1f5b-497d-900b-f6c6679af591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:05 devstack sudo[114384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (261b2f94-1f5b-497d-900b-f6c6679af591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3a1a786-a856-42ee-acb9-7f127f0a70fb', 'volume_name': 'volume-d3a1a786-a856-42ee-acb9-7f127f0a70fb', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eafeb7a-9dc6-4e6d-b298-1c3b1672ddb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eafeb7a-9dc6-4e6d-b298-1c3b1672ddb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ac6980-2eeb-4ab5-adf6-1e2d94790d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:05 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Volume d3a1a786-a856-42ee-acb9-7f127f0a70fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3a1a786-a856-42ee-acb9-7f127f0a70fb', 'volume_size': 1}
Jun 26 06:04:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:05 devstack sudo[114378]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD" returned: 0 in 1.012s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:05 devstack sudo[114388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD
Jun 26 06:04:05 devstack sudo[114388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:06 devstack sudo[114384]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a47b4425-2fad-48dd-8bf6-8f88d00e355e tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.d70fb768-24d6-48a6-bf11-974d8b94104d" returned: 0 in 0.833s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a47b4425-2fad-48dd-8bf6-8f88d00e355e tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:06 devstack sudo[114391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.info
Jun 26 06:04:06 devstack sudo[114391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:06 devstack sudo[114388]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD" returned: 1 in 0.834s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:04:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:06 devstack sudo[114391]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a47b4425-2fad-48dd-8bf6-8f88d00e355e tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.info" returned: 0 in 0.718s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:06 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-a47b4425-2fad-48dd-8bf6-8f88d00e355e tempest-CreateVolumesFromSnapshotTest-1424569728 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.info is being set with open permissions: ugo+rw
Jun 26 06:04:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a47b4425-2fad-48dd-8bf6-8f88d00e355e tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:07 devstack sudo[114397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.info
Jun 26 06:04:07 devstack sudo[114397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:07 devstack sudo[114397]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a47b4425-2fad-48dd-8bf6-8f88d00e355e tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.info" returned: 0 in 0.698s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a47b4425-2fad-48dd-8bf6-8f88d00e355e tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.408s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.041s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-344184919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=648b8a0c-c5a5-4c82-9967-eae5864f4a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceed338e169f41e69b4c5ba813d10246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:02Z,use_quota=True,user_id='3dac6e065b394e6787873d0576559e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:04:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Creating volume 648b8a0c-c5a5-4c82-9967-eae5864f4a6b {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:04:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:07 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:04:07 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:04:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-648b8a0c-c5a5-4c82-9967-eae5864f4a6b 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:07 devstack sudo[114400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-648b8a0c-c5a5-4c82-9967-eae5864f4a6b 1073741824
Jun 26 06:04:07 devstack sudo[114400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:07 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-a47b4425-2fad-48dd-8bf6-8f88d00e355e tempest-CreateVolumesFromSnapshotTest-1424569728 None] Create snapshot completed successfully
Jun 26 06:04:08 devstack sudo[114400]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-648b8a0c-c5a5-4c82-9967-eae5864f4a6b 1073741824" returned: 0 in 0.923s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-648b8a0c-c5a5-4c82-9967-eae5864f4a6b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:08 devstack sudo[114408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-648b8a0c-c5a5-4c82-9967-eae5864f4a6b
Jun 26 06:04:08 devstack sudo[114408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:08 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:04:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Flow 'volume_create_manager' (49b98903-d211-4b65-94c5-4a6d2e21a995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e9bfc1c-91eb-4d40-b63b-832278ac0c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e9bfc1c-91eb-4d40-b63b-832278ac0c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1687462329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba14749-8815-419d-8c30-dd1905b36605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9cd0e7f89b54891860894ac5e76c5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:09Z,use_quota=True,user_id='ead2fc55d161415c8b6d7342ffc56d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f402eff1-ec4b-4443-bb81-e9e230c0a8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f402eff1-ec4b-4443-bb81-e9e230c0a8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c76dfb2a-8e2a-4553-b978-877cb8685fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c76dfb2a-8e2a-4553-b978-877cb8685fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ba14749-8815-419d-8c30-dd1905b36605', 'volume_name': 'volume-4ba14749-8815-419d-8c30-dd1905b36605', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae59288-160c-4d7f-9af7-bf0ecfe1f986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae59288-160c-4d7f-9af7-bf0ecfe1f986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:08 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee71982-1168-4f66-8c68-ddfd0de999cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:08 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Volume 4ba14749-8815-419d-8c30-dd1905b36605: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ba14749-8815-419d-8c30-dd1905b36605', 'volume_size': 1}
Jun 26 06:04:08 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Flow 'volume_create_manager' (e618aba9-3f62-4759-903b-e7b5ef119737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b60c48-d8e2-4e66-8774-2bfc5b5e7290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b60c48-d8e2-4e66-8774-2bfc5b5e7290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2048963804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133e21ad-1e5e-4bdd-bc16-a363f59a23f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9cd0e7f89b54891860894ac5e76c5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:09Z,use_quota=True,user_id='ead2fc55d161415c8b6d7342ffc56d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c780bd8-d737-43f6-b01c-c841ff92b6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c780bd8-d737-43f6-b01c-c841ff92b6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739d9c43-84e7-4b9b-bcc6-ea82d8372137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739d9c43-84e7-4b9b-bcc6-ea82d8372137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '133e21ad-1e5e-4bdd-bc16-a363f59a23f5', 'volume_name': 'volume-133e21ad-1e5e-4bdd-bc16-a363f59a23f5', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f329a346-665e-44fd-bd5f-a4e9ec68b2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f329a346-665e-44fd-bd5f-a4e9ec68b2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7653267-a19a-4a89-a0a1-536b1aaeedc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:09 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Volume 133e21ad-1e5e-4bdd-bc16-a363f59a23f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-133e21ad-1e5e-4bdd-bc16-a363f59a23f5', 'volume_size': 1}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:09 devstack sudo[114408]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-648b8a0c-c5a5-4c82-9967-eae5864f4a6b" returned: 0 in 0.975s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.502s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1759664802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9fd526d-841c-4931-be44-a4a96122d28c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceed338e169f41e69b4c5ba813d10246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:03Z,use_quota=True,user_id='3dac6e065b394e6787873d0576559e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Creating volume e9fd526d-841c-4931-be44-a4a96122d28c {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:04:09 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9fd526d-841c-4931-be44-a4a96122d28c 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:09 devstack sudo[114411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9fd526d-841c-4931-be44-a4a96122d28c 1073741824
Jun 26 06:04:09 devstack sudo[114411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8281ae8c-dcd3-4ec4-b5d5-4c13afdf24f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-648b8a0c-c5a5-4c82-9967-eae5864f4a6b', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc62c060-8b46-48a8-a1f2-0f250456e7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Flow 'volume_create_manager' (82b243a5-54b6-47a2-a5ab-10077c4c65de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beaf2197-6f59-488b-97ad-4e1f9507d96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:09 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Volume volume-648b8a0c-c5a5-4c82-9967-eae5864f4a6b (648b8a0c-c5a5-4c82-9967-eae5864f4a6b): created successfully
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc62c060-8b46-48a8-a1f2-0f250456e7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Flow 'volume_create_manager' (231cd4e3-5427-49a2-add8-553017110a7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beaf2197-6f59-488b-97ad-4e1f9507d96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2087208660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22848975-7ed4-4164-8e52-029df2408dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9cd0e7f89b54891860894ac5e76c5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:10Z,use_quota=True,user_id='ead2fc55d161415c8b6d7342ffc56d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bfc2665-9f0c-4f64-87fa-f40bd4fcd9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bfc2665-9f0c-4f64-87fa-f40bd4fcd9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660d54ad-5c5e-402a-a56a-43c5b178b258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660d54ad-5c5e-402a-a56a-43c5b178b258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22848975-7ed4-4164-8e52-029df2408dd0', 'volume_name': 'volume-22848975-7ed4-4164-8e52-029df2408dd0', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928b5a37-24bc-40ce-941a-6bf68a1f7dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928b5a37-24bc-40ce-941a-6bf68a1f7dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83876f6-11ee-4255-b8ad-6b474a9d3840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:09 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Volume 22848975-7ed4-4164-8e52-029df2408dd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22848975-7ed4-4164-8e52-029df2408dd0', 'volume_size': 1}
Jun 26 06:04:09 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:09 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-0c2e8877-a18d-4912-b04d-3ab5d2c75893 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Created volume successfully.
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Flow 'volume_create_manager' (a53cef0b-5d02-46b0-bb01-fe37ca757d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dce6acc-2800-40ff-bd23-fbaa833376b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dce6acc-2800-40ff-bd23-fbaa833376b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2085520656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dddb131e-fc4a-4252-8f25-fd2480922e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9cd0e7f89b54891860894ac5e76c5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:10Z,use_quota=True,user_id='ead2fc55d161415c8b6d7342ffc56d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf3c67c-62a0-43f6-94df-76d6b20fd970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf3c67c-62a0-43f6-94df-76d6b20fd970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee38f3b2-e7a1-4da6-ac89-9df0bcdbb3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee38f3b2-e7a1-4da6-ac89-9df0bcdbb3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dddb131e-fc4a-4252-8f25-fd2480922e58', 'volume_name': 'volume-dddb131e-fc4a-4252-8f25-fd2480922e58', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d11fdbe-5368-47e1-b62c-a3436f3ed7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d11fdbe-5368-47e1-b62c-a3436f3ed7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04c4168-ce13-4824-a970-5d571804a2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:10 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Volume dddb131e-fc4a-4252-8f25-fd2480922e58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dddb131e-fc4a-4252-8f25-fd2480922e58', 'volume_size': 1}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Flow 'volume_create_manager' (36e756f5-fda1-40e6-81ad-c5f20ac59ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1394d407-2b3e-4a39-8483-0f63f4e77c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1394d407-2b3e-4a39-8483-0f63f4e77c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1758431958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee14f42-d93b-452f-b11d-f9fb605a45db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9cd0e7f89b54891860894ac5e76c5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:11Z,use_quota=True,user_id='ead2fc55d161415c8b6d7342ffc56d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db958c0b-dc1e-4216-b0a7-a37c06e2e323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db958c0b-dc1e-4216-b0a7-a37c06e2e323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed6e7f4-7c65-48a3-aa70-e41c017ecd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed6e7f4-7c65-48a3-aa70-e41c017ecd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ee14f42-d93b-452f-b11d-f9fb605a45db', 'volume_name': 'volume-6ee14f42-d93b-452f-b11d-f9fb605a45db', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6067f400-6eb5-4f7e-8311-9f40488c4021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6067f400-6eb5-4f7e-8311-9f40488c4021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e19e52a-51a6-42f9-adec-241fa439d6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:10 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Volume 6ee14f42-d93b-452f-b11d-f9fb605a45db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ee14f42-d93b-452f-b11d-f9fb605a45db', 'volume_size': 1}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:10 devstack sudo[114411]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9fd526d-841c-4931-be44-a4a96122d28c 1073741824" returned: 0 in 1.068s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:10 devstack sudo[114417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:04:10 devstack sudo[114417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9fd526d-841c-4931-be44-a4a96122d28c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:10 devstack sudo[114419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9fd526d-841c-4931-be44-a4a96122d28c
Jun 26 06:04:10 devstack sudo[114419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:11 devstack sudo[114417]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.709s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 28 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>, <Thread(tpool_thread_0, started daemon 124035494721216)>, <Thread(tpool_thread_1, started daemon 124035486328512)>, <Thread(tpool_thread_2, started daemon 124035477919424)>, <Thread(tpool_thread_3, started daemon 124035469510336)>, <Thread(tpool_thread_4, started daemon 124035461101248)>, <Thread(tpool_thread_5, started daemon 124035452692160)>, <Thread(tpool_thread_6, started daemon 124035444283072)>, <Thread(tpool_thread_7, started daemon 124035435873984)>, <Thread(tpool_thread_8, started daemon 124035427464896)>, <Thread(tpool_thread_9, started daemon 124035419055808)>, <Thread(tpool_thread_10, started daemon 124035410646720)>, <Thread(tpool_thread_11, started daemon 124035402237632)>, <Thread(tpool_thread_12, started daemon 124035393828544)>, <Thread(tpool_thread_13, started daemon 124035385419456)>, <Thread(tpool_thread_14, started daemon 124035377010368)>, <Thread(tpool_thread_15, started daemon 124035368601280)>, <Thread(tpool_thread_16, started daemon 124035360192192)>, <Thread(tpool_thread_17, started daemon 124035351783104)>, <Thread(tpool_thread_18, started daemon 124035343374016)>, <Thread(tpool_thread_19, started daemon 124035334964928)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 06:04:11 devstack sudo[114419]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9fd526d-841c-4931-be44-a4a96122d28c" returned: 0 in 0.748s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.529s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2014754324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c31f248-a4c6-4b3f-ac19-a624f2cfcafe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceed338e169f41e69b4c5ba813d10246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:04Z,use_quota=True,user_id='3dac6e065b394e6787873d0576559e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Creating volume 4c31f248-a4c6-4b3f-ac19-a624f2cfcafe {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:04:11 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:11 devstack sudo[114423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe 1073741824
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6649472-b5ae-465b-90c7-a445ed96e7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9fd526d-841c-4931-be44-a4a96122d28c', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:11 devstack sudo[114423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a494aba9-98c8-421b-ba6a-516938cb75ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:11 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Volume volume-e9fd526d-841c-4931-be44-a4a96122d28c (e9fd526d-841c-4931-be44-a4a96122d28c): created successfully
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a494aba9-98c8-421b-ba6a-516938cb75ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Flow 'volume_create_manager' (0a5c26cf-bf91-4c88-8598-ba2b282567df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:11 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-43e52972-ef78-47b8-8e07-06daea49e0ad tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Created volume successfully.
Jun 26 06:04:12 devstack sudo[114423]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe 1073741824" returned: 0 in 0.911s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:12 devstack sudo[114430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe
Jun 26 06:04:12 devstack sudo[114430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:13 devstack sudo[114430]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe" returned: 0 in 0.694s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:13 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:04:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.351s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:13 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-708251968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da2ed347-c2f0-4432-aa42-57d56f3b0c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceed338e169f41e69b4c5ba813d10246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:05Z,use_quota=True,user_id='3dac6e065b394e6787873d0576559e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:04:13 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Creating volume da2ed347-c2f0-4432-aa42-57d56f3b0c78 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:04:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:13 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:13 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:13 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:04:13 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:04:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-da2ed347-c2f0-4432-aa42-57d56f3b0c78 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:13 devstack sudo[114433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-da2ed347-c2f0-4432-aa42-57d56f3b0c78 1073741824
Jun 26 06:04:13 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e7af8d-41d5-4e3e-8c8c-6a65b7b74661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:13 devstack sudo[114433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:13 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a4e69c-b083-4319-9e9a-79bd213e5ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:13 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Volume volume-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe (4c31f248-a4c6-4b3f-ac19-a624f2cfcafe): created successfully
Jun 26 06:04:13 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a4e69c-b083-4319-9e9a-79bd213e5ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:13 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Flow 'volume_create_manager' (b2ea5742-7be0-43d5-bfab-e7c4dcb32cd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:13 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-a3218ff5-5907-41a8-86b9-bd2584627423 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Created volume successfully.
Jun 26 06:04:14 devstack sudo[114433]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-da2ed347-c2f0-4432-aa42-57d56f3b0c78 1073741824" returned: 0 in 1.094s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-da2ed347-c2f0-4432-aa42-57d56f3b0c78 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:14 devstack sudo[114440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-da2ed347-c2f0-4432-aa42-57d56f3b0c78
Jun 26 06:04:14 devstack sudo[114440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:15 devstack sudo[114440]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-da2ed347-c2f0-4432-aa42-57d56f3b0c78" returned: 0 in 0.694s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:04:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.524s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1753116903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a1a786-a856-42ee-acb9-7f127f0a70fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceed338e169f41e69b4c5ba813d10246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:05Z,use_quota=True,user_id='3dac6e065b394e6787873d0576559e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:04:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Creating volume d3a1a786-a856-42ee-acb9-7f127f0a70fb {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:04:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:04:15 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:04:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d3a1a786-a856-42ee-acb9-7f127f0a70fb 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:15 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b41440-d7ae-4d7b-8bb1-33139e6c0a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da2ed347-c2f0-4432-aa42-57d56f3b0c78', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:15 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891fc3a3-41c1-4a6e-965d-6bb4b77b406d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:15 devstack sudo[114444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d3a1a786-a856-42ee-acb9-7f127f0a70fb 1073741824
Jun 26 06:04:15 devstack sudo[114444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:15 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Volume volume-da2ed347-c2f0-4432-aa42-57d56f3b0c78 (da2ed347-c2f0-4432-aa42-57d56f3b0c78): created successfully
Jun 26 06:04:15 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891fc3a3-41c1-4a6e-965d-6bb4b77b406d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:15 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Flow 'volume_create_manager' (93403d2a-eca6-4a9a-9019-c9136792dbce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:15 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-f655cc88-b73f-4913-b521-f6c2ceeee388 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Created volume successfully.
Jun 26 06:04:15 devstack sudo[114444]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d3a1a786-a856-42ee-acb9-7f127f0a70fb 1073741824" returned: 0 in 0.948s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d3a1a786-a856-42ee-acb9-7f127f0a70fb {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:16 devstack sudo[114450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d3a1a786-a856-42ee-acb9-7f127f0a70fb
Jun 26 06:04:16 devstack sudo[114450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:16 devstack sudo[114450]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d3a1a786-a856-42ee-acb9-7f127f0a70fb" returned: 0 in 0.721s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:04:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.216s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86b6720b-d87f-4f87-92d9-5a4d7469f65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b68b52013fc42e683fd9b0e40f98990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:01Z,use_quota=True,user_id='c582d90c1df941a9a84234032a78878f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7046fe6d-bd93-49ae-8a91-794bd7adda80),volume_type_id=7046fe6d-bd93-49ae-8a91-794bd7adda80)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:04:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Creating volume 86b6720b-d87f-4f87-92d9-5a4d7469f65e {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:04:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:04:16 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:04:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:16 devstack sudo[114453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e 1073741824
Jun 26 06:04:16 devstack sudo[114453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ac6980-2eeb-4ab5-adf6-1e2d94790d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3a1a786-a856-42ee-acb9-7f127f0a70fb', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afefc2d-5bdc-470e-b2d5-79aebeec449a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:16 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Volume volume-d3a1a786-a856-42ee-acb9-7f127f0a70fb (d3a1a786-a856-42ee-acb9-7f127f0a70fb): created successfully
Jun 26 06:04:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afefc2d-5bdc-470e-b2d5-79aebeec449a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Flow 'volume_create_manager' (cd9f0c79-522a-4d72-a7bd-20c2faf186e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:16 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-296823a9-a123-4705-8ca8-ab467a5b0802 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Created volume successfully.
Jun 26 06:04:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-3613f67e-2e0a-494f-9e18-b07e33be0382 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "cinder-d3a1a786-a856-42ee-acb9-7f127f0a70fb-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-3613f67e-2e0a-494f-9e18-b07e33be0382 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-d3a1a786-a856-42ee-acb9-7f127f0a70fb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-3613f67e-2e0a-494f-9e18-b07e33be0382 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "cinder-quobyte-d3a1a786-a856-42ee-acb9-7f127f0a70fb" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:17 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-3613f67e-2e0a-494f-9e18-b07e33be0382 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-quobyte-d3a1a786-a856-42ee-acb9-7f127f0a70fb" acquired by "delete_volume" :: waited 0.020s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:17 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7055c09-3e25-462f-baf5-1f742bac83aa]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3613f67e-2e0a-494f-9e18-b07e33be0382 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d3a1a786-a856-42ee-acb9-7f127f0a70fb {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:17 devstack sudo[114458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d3a1a786-a856-42ee-acb9-7f127f0a70fb
Jun 26 06:04:17 devstack sudo[114458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:17 devstack sudo[114453]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e 1073741824" returned: 0 in 0.955s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:17 devstack sudo[114461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e
Jun 26 06:04:17 devstack sudo[114461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:18 devstack sudo[114458]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3613f67e-2e0a-494f-9e18-b07e33be0382 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d3a1a786-a856-42ee-acb9-7f127f0a70fb" returned: 0 in 0.872s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3613f67e-2e0a-494f-9e18-b07e33be0382 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d3a1a786-a856-42ee-acb9-7f127f0a70fb {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:18 devstack sudo[114467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d3a1a786-a856-42ee-acb9-7f127f0a70fb
Jun 26 06:04:18 devstack sudo[114467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:18 devstack sudo[114461]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e" returned: 0 in 0.837s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:04:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.679s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1687462329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba14749-8815-419d-8c30-dd1905b36605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9cd0e7f89b54891860894ac5e76c5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:09Z,use_quota=True,user_id='ead2fc55d161415c8b6d7342ffc56d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:04:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Creating volume 4ba14749-8815-419d-8c30-dd1905b36605 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:04:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:04:18 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:04:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4ba14749-8815-419d-8c30-dd1905b36605 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:18 devstack sudo[114470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4ba14749-8815-419d-8c30-dd1905b36605 1073741824
Jun 26 06:04:18 devstack sudo[114470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:18 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Attempting download of ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec ((None, [{'url': 'file:///opt/stack/data/glance/images/ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec', 'metadata': {}}])) to volume 86b6720b-d87f-4f87-92d9-5a4d7469f65e. {{(pid=93708) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 26 06:04:18 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[455df3ee-9d2a-4be0-9310-84c54810036b]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_95pid3yn {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:18 devstack sudo[114472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_95pid3yn
Jun 26 06:04:18 devstack sudo[114472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:19 devstack sudo[114467]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3613f67e-2e0a-494f-9e18-b07e33be0382 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-d3a1a786-a856-42ee-acb9-7f127f0a70fb" returned: 0 in 0.838s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-3613f67e-2e0a-494f-9e18-b07e33be0382 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-quobyte-d3a1a786-a856-42ee-acb9-7f127f0a70fb" released by "delete_volume" :: held 1.775s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:19 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-3613f67e-2e0a-494f-9e18-b07e33be0382 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Created reservations ['a7c5b1d3-1cbc-422a-b286-a2f179adc7dd', 'df40d9e7-a127-4297-882a-82cbe63b7799', '229f6fa4-6974-4239-94b5-a3ecd304e587', 'e1856d7f-2896-4cbe-aa94-4bacd953cf1b'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:04:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3613f67e-2e0a-494f-9e18-b07e33be0382 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3613f67e-2e0a-494f-9e18-b07e33be0382 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:19 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3613f67e-2e0a-494f-9e18-b07e33be0382 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:19 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3613f67e-2e0a-494f-9e18-b07e33be0382 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3613f67e-2e0a-494f-9e18-b07e33be0382 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3613f67e-2e0a-494f-9e18-b07e33be0382 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:19 devstack sudo[114478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:04:19 devstack sudo[114478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:19 devstack sudo[114472]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_95pid3yn" returned: 0 in 0.980s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_95pid3yn {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0fc9b0ca-48c7-4c87-a914-20c29108d360 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "cinder-da2ed347-c2f0-4432-aa42-57d56f3b0c78-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0fc9b0ca-48c7-4c87-a914-20c29108d360 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-da2ed347-c2f0-4432-aa42-57d56f3b0c78-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:19 devstack sudo[114470]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4ba14749-8815-419d-8c30-dd1905b36605 1073741824" returned: 0 in 1.207s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0fc9b0ca-48c7-4c87-a914-20c29108d360 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "cinder-quobyte-da2ed347-c2f0-4432-aa42-57d56f3b0c78" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0fc9b0ca-48c7-4c87-a914-20c29108d360 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-quobyte-da2ed347-c2f0-4432-aa42-57d56f3b0c78" acquired by "delete_volume" :: waited 0.032s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4ba14749-8815-419d-8c30-dd1905b36605 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:19 devstack sudo[114482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_95pid3yn
Jun 26 06:04:19 devstack sudo[114482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:19 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[608f8e46-f0ee-42a4-b55c-1ed9ca7655f9]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0fc9b0ca-48c7-4c87-a914-20c29108d360 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-da2ed347-c2f0-4432-aa42-57d56f3b0c78 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:19 devstack sudo[114484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4ba14749-8815-419d-8c30-dd1905b36605
Jun 26 06:04:19 devstack sudo[114484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:20 devstack sudo[114485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-da2ed347-c2f0-4432-aa42-57d56f3b0c78
Jun 26 06:04:20 devstack sudo[114485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:20 devstack sudo[114478]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3613f67e-2e0a-494f-9e18-b07e33be0382 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.228s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:20 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-3613f67e-2e0a-494f-9e18-b07e33be0382 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:04:20 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-3613f67e-2e0a-494f-9e18-b07e33be0382 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Deleted volume successfully.
Jun 26 06:04:20 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-3613f67e-2e0a-494f-9e18-b07e33be0382 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-d3a1a786-a856-42ee-acb9-7f127f0a70fb-delete_volume" released by "delete_volume" :: held 3.319s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:20 devstack sudo[114482]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_95pid3yn" returned: 1 in 1.231s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_95pid3yn' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:04:20 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bb2c1c-dbd1-4a4a-a32b-c425716d71f1]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:20 devstack sudo[114484]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4ba14749-8815-419d-8c30-dd1905b36605" returned: 0 in 1.093s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:20 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] <== create_volume: return (2382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:04:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.386s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.634s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:20 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2048963804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133e21ad-1e5e-4bdd-bc16-a363f59a23f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9cd0e7f89b54891860894ac5e76c5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:09Z,use_quota=True,user_id='ead2fc55d161415c8b6d7342ffc56d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:04:20 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Creating volume 133e21ad-1e5e-4bdd-bc16-a363f59a23f5 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:04:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:20 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:04:21 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:04:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-133e21ad-1e5e-4bdd-bc16-a363f59a23f5 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee71982-1168-4f66-8c68-ddfd0de999cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ba14749-8815-419d-8c30-dd1905b36605', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:21 devstack sudo[114496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-133e21ad-1e5e-4bdd-bc16-a363f59a23f5 1073741824
Jun 26 06:04:21 devstack sudo[114496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3a807fa-6bf1-49db-bd7b-fa53ca36ce76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:21 devstack sudo[114494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD
Jun 26 06:04:21 devstack sudo[114494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:21 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Volume volume-4ba14749-8815-419d-8c30-dd1905b36605 (4ba14749-8815-419d-8c30-dd1905b36605): created successfully
Jun 26 06:04:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3a807fa-6bf1-49db-bd7b-fa53ca36ce76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:21 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Flow 'volume_create_manager' (49b98903-d211-4b65-94c5-4a6d2e21a995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:21 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-fa15e948-cf1d-4fd2-92ca-6c24c65b9645 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Created volume successfully.
Jun 26 06:04:21 devstack sudo[114485]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0fc9b0ca-48c7-4c87-a914-20c29108d360 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-da2ed347-c2f0-4432-aa42-57d56f3b0c78" returned: 0 in 1.316s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0fc9b0ca-48c7-4c87-a914-20c29108d360 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-da2ed347-c2f0-4432-aa42-57d56f3b0c78 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:21 devstack sudo[114499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-da2ed347-c2f0-4432-aa42-57d56f3b0c78
Jun 26 06:04:21 devstack sudo[114499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:21 devstack sudo[114494]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD" returned: 0 in 0.890s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:21 devstack sudo[114508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD
Jun 26 06:04:21 devstack sudo[114508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:22 devstack sudo[114496]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-133e21ad-1e5e-4bdd-bc16-a363f59a23f5 1073741824" returned: 0 in 1.049s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:22 devstack sudo[114499]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0fc9b0ca-48c7-4c87-a914-20c29108d360 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-da2ed347-c2f0-4432-aa42-57d56f3b0c78" returned: 0 in 0.832s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0fc9b0ca-48c7-4c87-a914-20c29108d360 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-quobyte-da2ed347-c2f0-4432-aa42-57d56f3b0c78" released by "delete_volume" :: held 2.232s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-133e21ad-1e5e-4bdd-bc16-a363f59a23f5 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:04:22 devstack sudo[114510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-133e21ad-1e5e-4bdd-bc16-a363f59a23f5
Jun 26 06:04:22 devstack sudo[114510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Flow 'volume_create_manager' (faef1663-5012-44c1-9e89-99ed9ee0e306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30dd4629-0145-448b-9ec7-7376366fca63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30dd4629-0145-448b-9ec7-7376366fca63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1681174612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba791b6-b5cb-4890-9b46-8c0453a1aa0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b68efa356b54d299d2d7872c623127b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:22Z,use_quota=True,user_id='0957eb11ffb64e01a4168ea0ac3fbe61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656dd9c3-ec94-4f28-a63c-11ba1f11b499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656dd9c3-ec94-4f28-a63c-11ba1f11b499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f7d3af-4407-4366-8389-f857c81b672a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f7d3af-4407-4366-8389-f857c81b672a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eba791b6-b5cb-4890-9b46-8c0453a1aa0b', 'volume_name': 'volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740b68b8-3089-4921-b936-29dbd31c3391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740b68b8-3089-4921-b936-29dbd31c3391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c07597-d800-46f6-bf6e-8f35b5fd0725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:22 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Volume eba791b6-b5cb-4890-9b46-8c0453a1aa0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b', 'volume_size': 1}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-0fc9b0ca-48c7-4c87-a914-20c29108d360 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Created reservations ['a0843ea9-b222-4ff8-bd01-6cec0fdd16ae', '9e854c30-4e6a-4950-97a6-71d3c8fd1f71', '473175de-274e-43d4-b20b-685a07f763ac', '9d387386-a54e-4567-9b10-93c8351ccdde'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0fc9b0ca-48c7-4c87-a914-20c29108d360 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0fc9b0ca-48c7-4c87-a914-20c29108d360 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-0fc9b0ca-48c7-4c87-a914-20c29108d360 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-0fc9b0ca-48c7-4c87-a914-20c29108d360 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0fc9b0ca-48c7-4c87-a914-20c29108d360 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0fc9b0ca-48c7-4c87-a914-20c29108d360 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:22 devstack sudo[114513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:04:22 devstack sudo[114513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:22 devstack sudo[114508]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD" returned: 1 in 0.776s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec was raw, converting to raw {{(pid=93708) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:22 devstack sudo[114518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e
Jun 26 06:04:22 devstack sudo[114518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:22 devstack sudo[114510]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-133e21ad-1e5e-4bdd-bc16-a363f59a23f5" returned: 0 in 0.684s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.894s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.030s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2087208660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22848975-7ed4-4164-8e52-029df2408dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9cd0e7f89b54891860894ac5e76c5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:10Z,use_quota=True,user_id='ead2fc55d161415c8b6d7342ffc56d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Creating volume 22848975-7ed4-4164-8e52-029df2408dd0 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:04:22 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-22848975-7ed4-4164-8e52-029df2408dd0 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:22 devstack sudo[114521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-22848975-7ed4-4164-8e52-029df2408dd0 1073741824
Jun 26 06:04:22 devstack sudo[114521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7653267-a19a-4a89-a0a1-536b1aaeedc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-133e21ad-1e5e-4bdd-bc16-a363f59a23f5', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6193f3f-d288-4520-8ed2-0e92e1a51615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:22 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Volume volume-133e21ad-1e5e-4bdd-bc16-a363f59a23f5 (133e21ad-1e5e-4bdd-bc16-a363f59a23f5): created successfully
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6193f3f-d288-4520-8ed2-0e92e1a51615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:22 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Flow 'volume_create_manager' (e618aba9-3f62-4759-903b-e7b5ef119737) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:22 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-6899581d-638e-424f-8ec5-bf442a4d2c24 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Created volume successfully.
Jun 26 06:04:23 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e88eddfa-122f-43be-9f12-ab64300a0cd0 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "cinder-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:23 devstack sudo[114513]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:23 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e88eddfa-122f-43be-9f12-ab64300a0cd0 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0fc9b0ca-48c7-4c87-a914-20c29108d360 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.732s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:23 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-0fc9b0ca-48c7-4c87-a914-20c29108d360 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:04:23 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-0fc9b0ca-48c7-4c87-a914-20c29108d360 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Deleted volume successfully.
Jun 26 06:04:23 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e88eddfa-122f-43be-9f12-ab64300a0cd0 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "cinder-quobyte-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:23 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0fc9b0ca-48c7-4c87-a914-20c29108d360 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-da2ed347-c2f0-4432-aa42-57d56f3b0c78-delete_volume" released by "delete_volume" :: held 3.418s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:23 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e88eddfa-122f-43be-9f12-ab64300a0cd0 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-quobyte-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe" acquired by "delete_volume" :: waited 0.022s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:23 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[04625f54-afc3-4a82-acaf-206f95952c86]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e88eddfa-122f-43be-9f12-ab64300a0cd0 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:23 devstack sudo[114524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe
Jun 26 06:04:23 devstack sudo[114524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:23 devstack sudo[114518]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e" returned: 0 in 0.869s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:23 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec_uv0xfjnbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 06:04:23 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Converted 0.00 MB image at 0.00 MB/s
Jun 26 06:04:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:23 devstack sudo[114529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e 1G
Jun 26 06:04:23 devstack sudo[114529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:23 devstack sudo[114521]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-22848975-7ed4-4164-8e52-029df2408dd0 1073741824" returned: 0 in 0.984s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-22848975-7ed4-4164-8e52-029df2408dd0 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:23 devstack sudo[114536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-22848975-7ed4-4164-8e52-029df2408dd0
Jun 26 06:04:23 devstack sudo[114536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:24 devstack sudo[114524]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e88eddfa-122f-43be-9f12-ab64300a0cd0 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe" returned: 0 in 0.897s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e88eddfa-122f-43be-9f12-ab64300a0cd0 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:24 devstack sudo[114542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe
Jun 26 06:04:24 devstack sudo[114542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:24 devstack sudo[114529]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e 1G" returned: 0 in 0.761s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[859a356d-576a-43c5-99a3-430857784443]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:24 devstack sudo[114544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e
Jun 26 06:04:24 devstack sudo[114544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:24 devstack sudo[114536]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-22848975-7ed4-4164-8e52-029df2408dd0" returned: 0 in 0.708s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.327s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2085520656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dddb131e-fc4a-4252-8f25-fd2480922e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9cd0e7f89b54891860894ac5e76c5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:10Z,use_quota=True,user_id='ead2fc55d161415c8b6d7342ffc56d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Creating volume dddb131e-fc4a-4252-8f25-fd2480922e58 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:04:24 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dddb131e-fc4a-4252-8f25-fd2480922e58 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:24 devstack sudo[114547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dddb131e-fc4a-4252-8f25-fd2480922e58 1073741824
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83876f6-11ee-4255-b8ad-6b474a9d3840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22848975-7ed4-4164-8e52-029df2408dd0', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:24 devstack sudo[114547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (710d88f8-5d14-4c47-9d35-e9eb543330b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:24 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Volume volume-22848975-7ed4-4164-8e52-029df2408dd0 (22848975-7ed4-4164-8e52-029df2408dd0): created successfully
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (710d88f8-5d14-4c47-9d35-e9eb543330b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Flow 'volume_create_manager' (82b243a5-54b6-47a2-a5ab-10077c4c65de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:24 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-6d5d8f68-f540-4f39-bd97-966d407e47c4 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Created volume successfully.
Jun 26 06:04:24 devstack sudo[114542]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e88eddfa-122f-43be-9f12-ab64300a0cd0 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe" returned: 0 in 0.755s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e88eddfa-122f-43be-9f12-ab64300a0cd0 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-quobyte-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe" released by "delete_volume" :: held 1.700s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:24 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-e88eddfa-122f-43be-9f12-ab64300a0cd0 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Created reservations ['c5336c8f-429b-4504-9601-7173149d4464', '33a904ab-1548-42f4-aac3-8166af68af88', '3645a0cc-43a0-4ed5-9d0b-94f419b32dee', '60c13e75-1efe-4658-b148-f97a80e2b7d7'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:04:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e88eddfa-122f-43be-9f12-ab64300a0cd0 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e88eddfa-122f-43be-9f12-ab64300a0cd0 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:25 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e88eddfa-122f-43be-9f12-ab64300a0cd0 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:25 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e88eddfa-122f-43be-9f12-ab64300a0cd0 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e88eddfa-122f-43be-9f12-ab64300a0cd0 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e88eddfa-122f-43be-9f12-ab64300a0cd0 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:25 devstack sudo[114552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:04:25 devstack sudo[114552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:25 devstack sudo[114544]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e" returned: 0 in 0.847s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:25 devstack sudo[114554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e
Jun 26 06:04:25 devstack sudo[114554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:25 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5fc090cf-61bf-4ed4-a966-3c5648a7decf tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "cinder-e9fd526d-841c-4931-be44-a4a96122d28c-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:25 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5fc090cf-61bf-4ed4-a966-3c5648a7decf tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-e9fd526d-841c-4931-be44-a4a96122d28c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:25 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5fc090cf-61bf-4ed4-a966-3c5648a7decf tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "cinder-quobyte-e9fd526d-841c-4931-be44-a4a96122d28c" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:25 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5fc090cf-61bf-4ed4-a966-3c5648a7decf tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-quobyte-e9fd526d-841c-4931-be44-a4a96122d28c" acquired by "delete_volume" :: waited 0.022s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:25 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cef280b-1e86-499e-ace1-2706613bea23]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:25 devstack sudo[114547]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5fc090cf-61bf-4ed4-a966-3c5648a7decf tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9fd526d-841c-4931-be44-a4a96122d28c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dddb131e-fc4a-4252-8f25-fd2480922e58 1073741824" returned: 0 in 0.966s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dddb131e-fc4a-4252-8f25-fd2480922e58 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:25 devstack sudo[114562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dddb131e-fc4a-4252-8f25-fd2480922e58
Jun 26 06:04:25 devstack sudo[114562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:25 devstack sudo[114561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9fd526d-841c-4931-be44-a4a96122d28c
Jun 26 06:04:25 devstack sudo[114561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:25 devstack sudo[114552]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e88eddfa-122f-43be-9f12-ab64300a0cd0 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.936s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:25 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-e88eddfa-122f-43be-9f12-ab64300a0cd0 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:04:25 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e88eddfa-122f-43be-9f12-ab64300a0cd0 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Deleted volume successfully.
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e88eddfa-122f-43be-9f12-ab64300a0cd0 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-4c31f248-a4c6-4b3f-ac19-a624f2cfcafe-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:26 devstack sudo[114554]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e" returned: 1 in 1.046s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Downloaded image ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec ((None, [{'url': 'file:///opt/stack/data/glance/images/ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec', 'metadata': {}}])) to volume 86b6720b-d87f-4f87-92d9-5a4d7469f65e successfully. {{(pid=93708) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Temporary image ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec for user c582d90c1df941a9a84234032a78878f is deleted. {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Marking volume 86b6720b-d87f-4f87-92d9-5a4d7469f65e as bootable. {{(pid=93708) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Copying metadata from image ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec to 86b6720b-d87f-4f87-92d9-5a4d7469f65e. {{(pid=93708) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Creating volume glance metadata for volume 86b6720b-d87f-4f87-92d9-5a4d7469f65e backed by image ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cbaf0aa0f6b322f5cb422f19a4fc491a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93708) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3c8ae0-4047-47c3-b6c3-52ab7ecfafa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e', 'volume_size': 1, 'image_id': 'ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cbaf0aa0f6b322f5cb422f19a4fc491a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7b68b52013fc42e683fd9b0e40f98990', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a47d504173a6f98e9619098a4cd7c5416c9205932c0ff5dd7a09662e3d77295e6c62f10e32707249ef5400546b0aac9a259702154728f24689f993194dcddf8c', 'id': 'ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec', 'created_at': datetime.datetime(2026, 6, 26, 4, 3, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca9f1fbb-2f78-4c19-8fb8-7379b275e9ec/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf43a7bb00>}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5d6006-27ea-40d3-a9b6-871d130e20b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:26 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Volume volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e (86b6720b-d87f-4f87-92d9-5a4d7469f65e): created successfully
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5d6006-27ea-40d3-a9b6-871d130e20b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Flow 'volume_create_manager' (7e2b2756-be0b-4fbf-bad2-395a2b4ca31b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:26 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-6da29a28-6cbc-4b2b-945f-29028340d92d tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Created volume successfully.
Jun 26 06:04:26 devstack sudo[114562]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dddb131e-fc4a-4252-8f25-fd2480922e58" returned: 0 in 0.800s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.745s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1758431958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee14f42-d93b-452f-b11d-f9fb605a45db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9cd0e7f89b54891860894ac5e76c5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:11Z,use_quota=True,user_id='ead2fc55d161415c8b6d7342ffc56d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Creating volume 6ee14f42-d93b-452f-b11d-f9fb605a45db {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:04:26 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6ee14f42-d93b-452f-b11d-f9fb605a45db 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:26 devstack sudo[114561]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5fc090cf-61bf-4ed4-a966-3c5648a7decf tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9fd526d-841c-4931-be44-a4a96122d28c" returned: 0 in 0.889s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5fc090cf-61bf-4ed4-a966-3c5648a7decf tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9fd526d-841c-4931-be44-a4a96122d28c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:26 devstack sudo[114573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6ee14f42-d93b-452f-b11d-f9fb605a45db 1073741824
Jun 26 06:04:26 devstack sudo[114573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04c4168-ce13-4824-a970-5d571804a2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dddb131e-fc4a-4252-8f25-fd2480922e58', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e0a65f-7edc-44ce-826a-9b6f40abad2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:26 devstack sudo[114574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9fd526d-841c-4931-be44-a4a96122d28c
Jun 26 06:04:26 devstack sudo[114574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:26 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Volume volume-dddb131e-fc4a-4252-8f25-fd2480922e58 (dddb131e-fc4a-4252-8f25-fd2480922e58): created successfully
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e0a65f-7edc-44ce-826a-9b6f40abad2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Flow 'volume_create_manager' (a53cef0b-5d02-46b0-bb01-fe37ca757d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:26 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-f9e8d5a9-bfe8-42cc-9ca6-54eacd630dc9 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Created volume successfully.
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Acquiring lock "cinder-86b6720b-d87f-4f87-92d9-5a4d7469f65e-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Lock "cinder-86b6720b-d87f-4f87-92d9-5a4d7469f65e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Acquiring lock "cinder-quobyte-86b6720b-d87f-4f87-92d9-5a4d7469f65e" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Lock "cinder-quobyte-86b6720b-d87f-4f87-92d9-5a4d7469f65e" acquired by "delete_volume" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac9b490-adbf-49b7-923c-d48c74fb6983]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:26 devstack sudo[114577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e
Jun 26 06:04:26 devstack sudo[114577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:27 devstack sudo[114574]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5fc090cf-61bf-4ed4-a966-3c5648a7decf tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9fd526d-841c-4931-be44-a4a96122d28c" returned: 0 in 0.737s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5fc090cf-61bf-4ed4-a966-3c5648a7decf tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-quobyte-e9fd526d-841c-4931-be44-a4a96122d28c" released by "delete_volume" :: held 1.665s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:27 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-5fc090cf-61bf-4ed4-a966-3c5648a7decf tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Created reservations ['865b5947-85e5-41d8-be46-b03b802db433', '322af0f4-39a7-4ccf-8636-669193a60575', '79f349cf-844d-4420-82e7-190a27b68885', '9ca8bf90-5f83-46de-8cda-674dc708ba67'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:04:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-5fc090cf-61bf-4ed4-a966-3c5648a7decf tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-5fc090cf-61bf-4ed4-a966-3c5648a7decf tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-5fc090cf-61bf-4ed4-a966-3c5648a7decf tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:27 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-5fc090cf-61bf-4ed4-a966-3c5648a7decf tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-5fc090cf-61bf-4ed4-a966-3c5648a7decf tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5fc090cf-61bf-4ed4-a966-3c5648a7decf tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:27 devstack sudo[114583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:04:27 devstack sudo[114583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:27 devstack sudo[114573]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6ee14f42-d93b-452f-b11d-f9fb605a45db 1073741824" returned: 0 in 0.990s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6ee14f42-d93b-452f-b11d-f9fb605a45db {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:27 devstack sudo[114587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6ee14f42-d93b-452f-b11d-f9fb605a45db
Jun 26 06:04:27 devstack sudo[114587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:27 devstack sudo[114577]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e" returned: 0 in 0.834s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d2ebc160-135e-4b94-a708-34820c02bac8 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "cinder-648b8a0c-c5a5-4c82-9967-eae5864f4a6b-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d2ebc160-135e-4b94-a708-34820c02bac8 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-648b8a0c-c5a5-4c82-9967-eae5864f4a6b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:27 devstack sudo[114589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e
Jun 26 06:04:27 devstack sudo[114589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d2ebc160-135e-4b94-a708-34820c02bac8 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "cinder-quobyte-648b8a0c-c5a5-4c82-9967-eae5864f4a6b" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d2ebc160-135e-4b94-a708-34820c02bac8 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-quobyte-648b8a0c-c5a5-4c82-9967-eae5864f4a6b" acquired by "delete_volume" :: waited 0.030s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:27 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d2e422-1839-45e2-9de7-6fa1a20d5957]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d2ebc160-135e-4b94-a708-34820c02bac8 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-648b8a0c-c5a5-4c82-9967-eae5864f4a6b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:28 devstack sudo[114591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-648b8a0c-c5a5-4c82-9967-eae5864f4a6b
Jun 26 06:04:28 devstack sudo[114591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:28 devstack sudo[114583]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-5fc090cf-61bf-4ed4-a966-3c5648a7decf tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.724s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-5fc090cf-61bf-4ed4-a966-3c5648a7decf tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:04:28 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-5fc090cf-61bf-4ed4-a966-3c5648a7decf tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Deleted volume successfully.
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-5fc090cf-61bf-4ed4-a966-3c5648a7decf tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-e9fd526d-841c-4931-be44-a4a96122d28c-delete_volume" released by "delete_volume" :: held 2.716s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:28 devstack sudo[114587]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6ee14f42-d93b-452f-b11d-f9fb605a45db" returned: 0 in 0.789s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.976s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1681174612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba791b6-b5cb-4890-9b46-8c0453a1aa0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b68efa356b54d299d2d7872c623127b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:22Z,use_quota=True,user_id='0957eb11ffb64e01a4168ea0ac3fbe61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Creating volume eba791b6-b5cb-4890-9b46-8c0453a1aa0b {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:04:28 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e19e52a-51a6-42f9-adec-241fa439d6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ee14f42-d93b-452f-b11d-f9fb605a45db', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:28 devstack sudo[114597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b 1073741824
Jun 26 06:04:28 devstack sudo[114597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6569fb9-992c-4f61-89bd-3d5a6c6ef04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:28 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Volume volume-6ee14f42-d93b-452f-b11d-f9fb605a45db (6ee14f42-d93b-452f-b11d-f9fb605a45db): created successfully
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6569fb9-992c-4f61-89bd-3d5a6c6ef04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Flow 'volume_create_manager' (36e756f5-fda1-40e6-81ad-c5f20ac59ab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:28 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-301e82fb-fe23-4538-a95f-c607e8d9315a tempest-CreateVolumesFromSnapshotTest-1424569728 None] Created volume successfully.
Jun 26 06:04:28 devstack sudo[114589]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e" returned: 1 in 0.841s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:28 devstack sudo[114600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e
Jun 26 06:04:28 devstack sudo[114600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:28 devstack sudo[114591]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d2ebc160-135e-4b94-a708-34820c02bac8 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-648b8a0c-c5a5-4c82-9967-eae5864f4a6b" returned: 0 in 0.889s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d2ebc160-135e-4b94-a708-34820c02bac8 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-648b8a0c-c5a5-4c82-9967-eae5864f4a6b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:28 devstack sudo[114605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-648b8a0c-c5a5-4c82-9967-eae5864f4a6b
Jun 26 06:04:28 devstack sudo[114605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:29 devstack sudo[114600]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-86b6720b-d87f-4f87-92d9-5a4d7469f65e" returned: 0 in 0.727s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Lock "cinder-quobyte-86b6720b-d87f-4f87-92d9-5a4d7469f65e" released by "delete_volume" :: held 2.479s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:29 devstack sudo[114597]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b 1073741824" returned: 0 in 0.921s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Created reservations ['a867f3a1-5fd6-42a0-b5a8-022568daab32', 'f84342ad-b04f-4390-8d45-3be3421e2936', 'f9c4b210-941a-4779-b7c1-2fd2d49872a9', '5ce644cf-27d3-4290-8a97-74425b2d922b'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:04:29 devstack sudo[114612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b
Jun 26 06:04:29 devstack sudo[114612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e1078661-e710-4390-9c83-2b6d041a2ee6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "cinder-6ee14f42-d93b-452f-b11d-f9fb605a45db-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e1078661-e710-4390-9c83-2b6d041a2ee6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-6ee14f42-d93b-452f-b11d-f9fb605a45db-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:29 devstack sudo[114615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e1078661-e710-4390-9c83-2b6d041a2ee6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "cinder-quobyte-6ee14f42-d93b-452f-b11d-f9fb605a45db" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:29 devstack sudo[114615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e1078661-e710-4390-9c83-2b6d041a2ee6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-quobyte-6ee14f42-d93b-452f-b11d-f9fb605a45db" acquired by "delete_volume" :: waited 0.022s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:29 devstack sudo[114605]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d2ebc160-135e-4b94-a708-34820c02bac8 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-648b8a0c-c5a5-4c82-9967-eae5864f4a6b" returned: 0 in 0.772s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fc957b-5d9a-455e-918e-8879d841fc47]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e1078661-e710-4390-9c83-2b6d041a2ee6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6ee14f42-d93b-452f-b11d-f9fb605a45db {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d2ebc160-135e-4b94-a708-34820c02bac8 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-quobyte-648b8a0c-c5a5-4c82-9967-eae5864f4a6b" released by "delete_volume" :: held 1.745s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-d2ebc160-135e-4b94-a708-34820c02bac8 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Created reservations ['31507462-4b12-42b5-8907-f075c2aba0d1', '0aefb407-0f75-4d37-b9cc-2f15120a3957', 'c517c242-6e47-469f-a766-9cf59834e5e7', 'f863d150-5330-4a8b-9019-4793f4a81447'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:04:29 devstack sudo[114617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6ee14f42-d93b-452f-b11d-f9fb605a45db
Jun 26 06:04:29 devstack sudo[114617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d2ebc160-135e-4b94-a708-34820c02bac8 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d2ebc160-135e-4b94-a708-34820c02bac8 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d2ebc160-135e-4b94-a708-34820c02bac8 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-d2ebc160-135e-4b94-a708-34820c02bac8 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-d2ebc160-135e-4b94-a708-34820c02bac8 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d2ebc160-135e-4b94-a708-34820c02bac8 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:29 devstack sudo[114619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:04:29 devstack sudo[114619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-bdcae33d-33ee-478b-8288-adf94213fcca tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "cinder-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-bdcae33d-33ee-478b-8288-adf94213fcca tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-bdcae33d-33ee-478b-8288-adf94213fcca tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "cinder-quobyte-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-bdcae33d-33ee-478b-8288-adf94213fcca tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-quobyte-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513" acquired by "delete_volume" :: waited 0.044s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:30 devstack sudo[114612]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b" returned: 0 in 0.940s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:30 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:04:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:30 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6876486-f79f-41f5-984c-45c0eebb8302]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c07597-d800-46f6-bf6e-8f35b5fd0725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26b9438-5c78-4772-8982-bd3ce1cfbb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bdcae33d-33ee-478b-8288-adf94213fcca tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:30 devstack sudo[114615]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:30 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Volume volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b (eba791b6-b5cb-4890-9b46-8c0453a1aa0b): created successfully
Jun 26 06:04:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26b9438-5c78-4772-8982-bd3ce1cfbb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:30 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Flow 'volume_create_manager' (faef1663-5012-44c1-9e89-99ed9ee0e306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.880s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:30 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:04:30 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Deleted volume successfully.
Jun 26 06:04:30 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-3ed35f77-07c5-4524-bd77-61d0424d4f06 tempest-SnapshotDependencyTests-1278970603 None] Created volume successfully.
Jun 26 06:04:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8157bc95-f01a-4ec3-810d-5b32d9c01e88 tempest-VolumeAndVolumeTypeFromImageTest-1638071195 None] Lock "cinder-86b6720b-d87f-4f87-92d9-5a4d7469f65e-delete_volume" released by "delete_volume" :: held 3.723s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:30 devstack sudo[114623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513
Jun 26 06:04:30 devstack sudo[114623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:30 devstack sudo[114619]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-d2ebc160-135e-4b94-a708-34820c02bac8 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.893s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:30 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-d2ebc160-135e-4b94-a708-34820c02bac8 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:04:30 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-d2ebc160-135e-4b94-a708-34820c02bac8 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Deleted volume successfully.
Jun 26 06:04:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-d2ebc160-135e-4b94-a708-34820c02bac8 tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-648b8a0c-c5a5-4c82-9967-eae5864f4a6b-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:30 devstack sudo[114617]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e1078661-e710-4390-9c83-2b6d041a2ee6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6ee14f42-d93b-452f-b11d-f9fb605a45db" returned: 0 in 1.167s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e1078661-e710-4390-9c83-2b6d041a2ee6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6ee14f42-d93b-452f-b11d-f9fb605a45db {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:30 devstack sudo[114629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6ee14f42-d93b-452f-b11d-f9fb605a45db
Jun 26 06:04:30 devstack sudo[114629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-868412fe-087b-473c-9cd4-97d36d396cc6 tempest-SnapshotDependencyTests-1278970603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-868412fe-087b-473c-9cd4-97d36d396cc6 tempest-SnapshotDependencyTests-1278970603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-868412fe-087b-473c-9cd4-97d36d396cc6 tempest-SnapshotDependencyTests-1278970603 None] Creating offline snapshot 9190a748-4fab-4ffb-a8df-0df34d2ae04e of volume eba791b6-b5cb-4890-9b46-8c0453a1aa0b {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 06:04:31 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[f614b6bb-ff8e-4b21-990e-957b58fe8a2f]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-868412fe-087b-473c-9cd4-97d36d396cc6 tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:31 devstack sudo[114631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b
Jun 26 06:04:31 devstack sudo[114631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:31 devstack sudo[114623]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bdcae33d-33ee-478b-8288-adf94213fcca tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513" returned: 0 in 1.068s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bdcae33d-33ee-478b-8288-adf94213fcca tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:31 devstack sudo[114637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513
Jun 26 06:04:31 devstack sudo[114637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:31 devstack sudo[114629]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e1078661-e710-4390-9c83-2b6d041a2ee6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-6ee14f42-d93b-452f-b11d-f9fb605a45db" returned: 0 in 0.862s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e1078661-e710-4390-9c83-2b6d041a2ee6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-quobyte-6ee14f42-d93b-452f-b11d-f9fb605a45db" released by "delete_volume" :: held 2.103s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:31 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-e1078661-e710-4390-9c83-2b6d041a2ee6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Created reservations ['364cc9ae-e2ac-4262-bac8-72439b960690', '7398c405-3b17-4f67-9f86-8bf84eb4ed50', 'be914fd4-0cd1-48d9-9354-2ec12189f827', '90117ef1-514a-4294-abd0-448de6593625'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:04:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e1078661-e710-4390-9c83-2b6d041a2ee6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e1078661-e710-4390-9c83-2b6d041a2ee6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e1078661-e710-4390-9c83-2b6d041a2ee6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:31 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e1078661-e710-4390-9c83-2b6d041a2ee6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e1078661-e710-4390-9c83-2b6d041a2ee6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e1078661-e710-4390-9c83-2b6d041a2ee6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:31 devstack sudo[114640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:04:31 devstack sudo[114640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:32 devstack sudo[114631]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-868412fe-087b-473c-9cd4-97d36d396cc6 tempest-SnapshotDependencyTests-1278970603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b" returned: 0 in 1.001s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-868412fe-087b-473c-9cd4-97d36d396cc6 tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:32 devstack sudo[114646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e 1G
Jun 26 06:04:32 devstack sudo[114646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:32 devstack sudo[114637]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bdcae33d-33ee-478b-8288-adf94213fcca tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513" returned: 0 in 0.862s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-bdcae33d-33ee-478b-8288-adf94213fcca tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-quobyte-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513" released by "delete_volume" :: held 2.033s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:32 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-bdcae33d-33ee-478b-8288-adf94213fcca tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Created reservations ['78f0c7d0-cf9e-4abb-bbad-bb09713b8781', '03fe57a4-97e7-4a68-8d13-388d4e437f05', 'e12ab831-6a77-4d0a-bada-956e5ebc71d0', '80ebbffb-20ac-4d47-916f-7a56d63ca3a6'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:04:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-bdcae33d-33ee-478b-8288-adf94213fcca tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-bdcae33d-33ee-478b-8288-adf94213fcca tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:32 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-bdcae33d-33ee-478b-8288-adf94213fcca tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:32 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-bdcae33d-33ee-478b-8288-adf94213fcca tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-bdcae33d-33ee-478b-8288-adf94213fcca tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bdcae33d-33ee-478b-8288-adf94213fcca tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:32 devstack sudo[114648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:04:32 devstack sudo[114648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:32 devstack sudo[114640]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e1078661-e710-4390-9c83-2b6d041a2ee6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.010s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:32 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-e1078661-e710-4390-9c83-2b6d041a2ee6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:04:32 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e1078661-e710-4390-9c83-2b6d041a2ee6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Deleted volume successfully.
Jun 26 06:04:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4cfd4ae3-cad6-4edc-a22e-6588ccc1a6cb tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "cinder-dddb131e-fc4a-4252-8f25-fd2480922e58-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4cfd4ae3-cad6-4edc-a22e-6588ccc1a6cb tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-dddb131e-fc4a-4252-8f25-fd2480922e58-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e1078661-e710-4390-9c83-2b6d041a2ee6 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-6ee14f42-d93b-452f-b11d-f9fb605a45db-delete_volume" released by "delete_volume" :: held 3.536s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4cfd4ae3-cad6-4edc-a22e-6588ccc1a6cb tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "cinder-quobyte-dddb131e-fc4a-4252-8f25-fd2480922e58" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:33 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4cfd4ae3-cad6-4edc-a22e-6588ccc1a6cb tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-quobyte-dddb131e-fc4a-4252-8f25-fd2480922e58" acquired by "delete_volume" :: waited 0.020s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:33 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[d114ed3d-1acb-4a5b-b23a-1b89929d93bf]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4cfd4ae3-cad6-4edc-a22e-6588ccc1a6cb tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dddb131e-fc4a-4252-8f25-fd2480922e58 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:33 devstack sudo[114689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dddb131e-fc4a-4252-8f25-fd2480922e58
Jun 26 06:04:33 devstack sudo[114689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:33 devstack sudo[114648]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-bdcae33d-33ee-478b-8288-adf94213fcca tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.065s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:33 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-bdcae33d-33ee-478b-8288-adf94213fcca tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:04:33 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-bdcae33d-33ee-478b-8288-adf94213fcca tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Deleted volume successfully.
Jun 26 06:04:33 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-bdcae33d-33ee-478b-8288-adf94213fcca tempest-CreateVolumesFromSourceVolumeTest-1187786087 None] Lock "cinder-88ab7d9e-4928-4c21-8fa4-17b5cbfa8513-delete_volume" released by "delete_volume" :: held 3.459s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:33 devstack sudo[114646]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-868412fe-087b-473c-9cd4-97d36d396cc6 tempest-SnapshotDependencyTests-1278970603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e 1G" returned: 0 in 1.484s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-868412fe-087b-473c-9cd4-97d36d396cc6 tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:33 devstack sudo[114697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e
Jun 26 06:04:33 devstack sudo[114697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:34 devstack sudo[114689]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4cfd4ae3-cad6-4edc-a22e-6588ccc1a6cb tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dddb131e-fc4a-4252-8f25-fd2480922e58" returned: 0 in 1.159s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4cfd4ae3-cad6-4edc-a22e-6588ccc1a6cb tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dddb131e-fc4a-4252-8f25-fd2480922e58 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:34 devstack sudo[114702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dddb131e-fc4a-4252-8f25-fd2480922e58
Jun 26 06:04:34 devstack sudo[114702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:34 devstack sudo[114697]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-868412fe-087b-473c-9cd4-97d36d396cc6 tempest-SnapshotDependencyTests-1278970603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e" returned: 0 in 0.980s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:34 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-868412fe-087b-473c-9cd4-97d36d396cc6 tempest-SnapshotDependencyTests-1278970603 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e is being set with open permissions: ugo+rw
Jun 26 06:04:34 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-868412fe-087b-473c-9cd4-97d36d396cc6 tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:34 devstack sudo[114708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e
Jun 26 06:04:34 devstack sudo[114708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:35 devstack sudo[114702]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4cfd4ae3-cad6-4edc-a22e-6588ccc1a6cb tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-dddb131e-fc4a-4252-8f25-fd2480922e58" returned: 0 in 0.914s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:35 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4cfd4ae3-cad6-4edc-a22e-6588ccc1a6cb tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-quobyte-dddb131e-fc4a-4252-8f25-fd2480922e58" released by "delete_volume" :: held 2.152s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:35 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-4cfd4ae3-cad6-4edc-a22e-6588ccc1a6cb tempest-CreateVolumesFromSnapshotTest-1424569728 None] Created reservations ['f9c59491-5cdf-4250-a995-d31259962520', '2b1947f7-e99c-49f1-8ef9-20871cd5bb84', '2d654437-a39a-41dd-87a4-4b25871f12ad', 'a9ee2efd-c394-4f8f-ae41-64931391a7f9'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:04:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4cfd4ae3-cad6-4edc-a22e-6588ccc1a6cb tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4cfd4ae3-cad6-4edc-a22e-6588ccc1a6cb tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:35 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4cfd4ae3-cad6-4edc-a22e-6588ccc1a6cb tempest-CreateVolumesFromSnapshotTest-1424569728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:35 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-4cfd4ae3-cad6-4edc-a22e-6588ccc1a6cb tempest-CreateVolumesFromSnapshotTest-1424569728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-4cfd4ae3-cad6-4edc-a22e-6588ccc1a6cb tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4cfd4ae3-cad6-4edc-a22e-6588ccc1a6cb tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:35 devstack sudo[114712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:04:35 devstack sudo[114712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:35 devstack sudo[114708]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-868412fe-087b-473c-9cd4-97d36d396cc6 tempest-SnapshotDependencyTests-1278970603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e" returned: 0 in 0.810s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:35 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-868412fe-087b-473c-9cd4-97d36d396cc6 tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:35 devstack sudo[114714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.info
Jun 26 06:04:35 devstack sudo[114714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Flow 'volume_create_manager' (83d84be7-a088-4656-a764-a0cf6b8f5ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86acb7bf-87fd-441b-85c6-e244160dc7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86acb7bf-87fd-441b-85c6-e244160dc7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1763303273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a8b026-caf8-4544-a9d0-6b9514c4d501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='806d3babf8324c5db1825b45b3848692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:36Z,use_quota=True,user_id='cee13c7642f64c51a1dd2e142344b4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1c6603-43a7-4137-86a9-7707695380c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1c6603-43a7-4137-86a9-7707695380c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6bdcb5-1073-4cf5-9a1b-2d7850e2871b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6bdcb5-1073-4cf5-9a1b-2d7850e2871b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72a8b026-caf8-4544-a9d0-6b9514c4d501', 'volume_name': 'volume-72a8b026-caf8-4544-a9d0-6b9514c4d501', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f9af54-ff5d-45e7-a940-be1ac4407213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f9af54-ff5d-45e7-a940-be1ac4407213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:36 devstack sudo[114712]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394e38df-7e19-4d87-ad36-8b260b79988a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:36 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Volume 72a8b026-caf8-4544-a9d0-6b9514c4d501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72a8b026-caf8-4544-a9d0-6b9514c4d501', 'volume_size': 1}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-4cfd4ae3-cad6-4edc-a22e-6588ccc1a6cb tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.869s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-4cfd4ae3-cad6-4edc-a22e-6588ccc1a6cb tempest-CreateVolumesFromSnapshotTest-1424569728 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:04:36 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-4cfd4ae3-cad6-4edc-a22e-6588ccc1a6cb tempest-CreateVolumesFromSnapshotTest-1424569728 None] Deleted volume successfully.
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-4cfd4ae3-cad6-4edc-a22e-6588ccc1a6cb tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-dddb131e-fc4a-4252-8f25-fd2480922e58-delete_volume" released by "delete_volume" :: held 3.336s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:36 devstack sudo[114714]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-868412fe-087b-473c-9cd4-97d36d396cc6 tempest-SnapshotDependencyTests-1278970603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.info" returned: 0 in 0.858s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:36 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-868412fe-087b-473c-9cd4-97d36d396cc6 tempest-SnapshotDependencyTests-1278970603 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.info is being set with open permissions: ugo+rw
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-868412fe-087b-473c-9cd4-97d36d396cc6 tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:36 devstack sudo[114718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.info
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-10e8167a-3f92-4a22-b533-118cd0e1efe0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "cinder-22848975-7ed4-4164-8e52-029df2408dd0-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:36 devstack sudo[114718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-10e8167a-3f92-4a22-b533-118cd0e1efe0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-22848975-7ed4-4164-8e52-029df2408dd0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-10e8167a-3f92-4a22-b533-118cd0e1efe0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "cinder-quobyte-22848975-7ed4-4164-8e52-029df2408dd0" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-10e8167a-3f92-4a22-b533-118cd0e1efe0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-quobyte-22848975-7ed4-4164-8e52-029df2408dd0" acquired by "delete_volume" :: waited 0.022s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e691f1-9889-442b-9c34-1d30c3bbd590]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-10e8167a-3f92-4a22-b533-118cd0e1efe0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-22848975-7ed4-4164-8e52-029df2408dd0 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:36 devstack sudo[114720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-22848975-7ed4-4164-8e52-029df2408dd0
Jun 26 06:04:36 devstack sudo[114720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Flow 'volume_create_manager' (9a6c42eb-12c1-4eda-a238-f88420f8ba24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265d9f43-f646-4792-94b5-3d770174414e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265d9f43-f646-4792-94b5-3d770174414e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1847114609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d6e5a7-aa37-4d9a-9074-4e49429b57ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='806d3babf8324c5db1825b45b3848692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:37Z,use_quota=True,user_id='cee13c7642f64c51a1dd2e142344b4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b47b26-379b-4efe-a76b-62f92bf44bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b47b26-379b-4efe-a76b-62f92bf44bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e90018-6b2b-43fc-9534-91ade3acfe1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e90018-6b2b-43fc-9534-91ade3acfe1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1d6e5a7-aa37-4d9a-9074-4e49429b57ae', 'volume_name': 'volume-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c65db38-fa2b-4e03-9ca0-0ee76f265ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c65db38-fa2b-4e03-9ca0-0ee76f265ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140f49fd-538d-469a-a01d-d48d81ad72d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:36 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Volume e1d6e5a7-aa37-4d9a-9074-4e49429b57ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae', 'volume_size': 1}
Jun 26 06:04:36 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:37 devstack sudo[114718]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-868412fe-087b-473c-9cd4-97d36d396cc6 tempest-SnapshotDependencyTests-1278970603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.info" returned: 0 in 0.917s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-868412fe-087b-473c-9cd4-97d36d396cc6 tempest-SnapshotDependencyTests-1278970603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.178s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.048s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1763303273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a8b026-caf8-4544-a9d0-6b9514c4d501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='806d3babf8324c5db1825b45b3848692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:36Z,use_quota=True,user_id='cee13c7642f64c51a1dd2e142344b4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Creating volume 72a8b026-caf8-4544-a9d0-6b9514c4d501 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:04:37 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-72a8b026-caf8-4544-a9d0-6b9514c4d501 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:37 devstack sudo[114723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-72a8b026-caf8-4544-a9d0-6b9514c4d501 1073741824
Jun 26 06:04:37 devstack sudo[114723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Flow 'volume_create_manager' (fd35b5b8-513a-4779-9e5c-10c5390411d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f3b9b6-a7d0-4c87-9bea-4d4f9414c8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f3b9b6-a7d0-4c87-9bea-4d4f9414c8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-832410223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57504cc-6a1b-4d33-ba8f-4d83b3b1666f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='806d3babf8324c5db1825b45b3848692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:37Z,use_quota=True,user_id='cee13c7642f64c51a1dd2e142344b4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a8483b-2f65-46ee-a551-c786c57f0367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a8483b-2f65-46ee-a551-c786c57f0367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e920b3a9-3967-4bff-8522-97624077ce7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e920b3a9-3967-4bff-8522-97624077ce7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b57504cc-6a1b-4d33-ba8f-4d83b3b1666f', 'volume_name': 'volume-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224e001f-18c2-4f51-bca4-1dd0d7aef62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224e001f-18c2-4f51-bca4-1dd0d7aef62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b32865a-6060-47a3-83c0-3a2d90dac59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:37 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Volume b57504cc-6a1b-4d33-ba8f-4d83b3b1666f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f', 'volume_size': 1}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:37 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-868412fe-087b-473c-9cd4-97d36d396cc6 tempest-SnapshotDependencyTests-1278970603 None] Create snapshot completed successfully
Jun 26 06:04:37 devstack sudo[114720]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-10e8167a-3f92-4a22-b533-118cd0e1efe0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-22848975-7ed4-4164-8e52-029df2408dd0" returned: 0 in 1.271s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:37 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-10e8167a-3f92-4a22-b533-118cd0e1efe0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-22848975-7ed4-4164-8e52-029df2408dd0 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:37 devstack sudo[114729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-22848975-7ed4-4164-8e52-029df2408dd0
Jun 26 06:04:37 devstack sudo[114729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Flow 'volume_create_manager' (2c4bd775-7714-45dc-8fa7-117589aa95c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2805bb3-b31b-4852-82ae-ef9c37755a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2805bb3-b31b-4852-82ae-ef9c37755a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-979919338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04896fbc-45ee-45a7-88bd-1eaa34a6647a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='806d3babf8324c5db1825b45b3848692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:38Z,use_quota=True,user_id='cee13c7642f64c51a1dd2e142344b4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64279212-9635-411c-8996-4089f60428ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64279212-9635-411c-8996-4089f60428ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51dc9f4b-c025-4471-9013-d6bf38b77fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51dc9f4b-c025-4471-9013-d6bf38b77fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04896fbc-45ee-45a7-88bd-1eaa34a6647a', 'volume_name': 'volume-04896fbc-45ee-45a7-88bd-1eaa34a6647a', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e6dddb-c586-402c-a4b0-3f2b0a65fa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e6dddb-c586-402c-a4b0-3f2b0a65fa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d262b78-3e91-4c77-9909-7084830ebdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:38 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Volume 04896fbc-45ee-45a7-88bd-1eaa34a6647a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04896fbc-45ee-45a7-88bd-1eaa34a6647a', 'volume_size': 1}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Flow 'volume_create_manager' (995556ef-1a3e-4f0c-ab6c-636b51ab91dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f31f01-b1b6-4f78-9db2-fec548e0fba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Flow 'volume_create_manager' (894e3916-ad16-4795-90a1-6f2508311e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2e099e-ee1b-48c1-89c6-6826b1368d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f31f01-b1b6-4f78-9db2-fec548e0fba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1594899116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b130075f-e184-4a05-9909-dbb4fbaf3d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea1b070700a4ae9af28b14f063af032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:38Z,use_quota=True,user_id='7237cbc6ead94420ab8a2bf378b22480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:38 devstack sudo[114723]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbfa0afa-6c14-46c6-a57a-e7e74f70d6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbfa0afa-6c14-46c6-a57a-e7e74f70d6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31982ac8-fc19-4f60-afb1-44354e1fc69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:38 devstack sudo[114729]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31982ac8-fc19-4f60-afb1-44354e1fc69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b130075f-e184-4a05-9909-dbb4fbaf3d49', 'volume_name': 'volume-b130075f-e184-4a05-9909-dbb4fbaf3d49', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b03375-6cdf-4633-a546-a4b35f2693be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b03375-6cdf-4633-a546-a4b35f2693be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f463987b-d3ee-41b2-819c-1bdb852b55d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:38 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Volume b130075f-e184-4a05-9909-dbb4fbaf3d49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b130075f-e184-4a05-9909-dbb4fbaf3d49', 'volume_size': 1}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-72a8b026-caf8-4544-a9d0-6b9514c4d501 1073741824" returned: 0 in 1.188s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-10e8167a-3f92-4a22-b533-118cd0e1efe0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-22848975-7ed4-4164-8e52-029df2408dd0" returned: 0 in 0.739s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2e099e-ee1b-48c1-89c6-6826b1368d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-717857566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b52ff3d-c086-42bc-8972-ed43772e4cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='806d3babf8324c5db1825b45b3848692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:38Z,use_quota=True,user_id='cee13c7642f64c51a1dd2e142344b4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f38e37-3692-433d-96db-42c429f957b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f38e37-3692-433d-96db-42c429f957b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec15dcb6-f24f-4a9e-a845-246e418bf4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec15dcb6-f24f-4a9e-a845-246e418bf4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b52ff3d-c086-42bc-8972-ed43772e4cb8', 'volume_name': 'volume-0b52ff3d-c086-42bc-8972-ed43772e4cb8', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7143b6e-61f6-48cb-9f89-ce88462c76b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7143b6e-61f6-48cb-9f89-ce88462c76b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984d6d3e-7b0b-4f92-a43e-f1648f80c635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:38 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Volume 0b52ff3d-c086-42bc-8972-ed43772e4cb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b52ff3d-c086-42bc-8972-ed43772e4cb8', 'volume_size': 1}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-10e8167a-3f92-4a22-b533-118cd0e1efe0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-quobyte-22848975-7ed4-4164-8e52-029df2408dd0" released by "delete_volume" :: held 2.119s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-72a8b026-caf8-4544-a9d0-6b9514c4d501 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:38 devstack sudo[114739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-72a8b026-caf8-4544-a9d0-6b9514c4d501
Jun 26 06:04:38 devstack sudo[114739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-10e8167a-3f92-4a22-b533-118cd0e1efe0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Created reservations ['bc08b44d-a237-4ca0-9087-38411613f9d2', '223a47cb-e8b4-4ecc-a3d5-427305f9fe7b', '8f0878de-5e64-41a9-afd5-ad0f918f6291', '5b542d40-505a-4dda-bf43-adc7c3651434'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-10e8167a-3f92-4a22-b533-118cd0e1efe0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-10e8167a-3f92-4a22-b533-118cd0e1efe0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-10e8167a-3f92-4a22-b533-118cd0e1efe0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-10e8167a-3f92-4a22-b533-118cd0e1efe0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-10e8167a-3f92-4a22-b533-118cd0e1efe0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:38 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-10e8167a-3f92-4a22-b533-118cd0e1efe0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:38 devstack sudo[114741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:04:38 devstack sudo[114741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:04:39 devstack sudo[114739]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-72a8b026-caf8-4544-a9d0-6b9514c4d501" returned: 0 in 0.757s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.572s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1847114609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d6e5a7-aa37-4d9a-9074-4e49429b57ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='806d3babf8324c5db1825b45b3848692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:37Z,use_quota=True,user_id='cee13c7642f64c51a1dd2e142344b4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Creating volume e1d6e5a7-aa37-4d9a-9074-4e49429b57ae {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:04:39 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394e38df-7e19-4d87-ad36-8b260b79988a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72a8b026-caf8-4544-a9d0-6b9514c4d501', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8bbb9a6-367b-4a8f-9b44-64c0251b8ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:39 devstack sudo[114744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae 1073741824
Jun 26 06:04:39 devstack sudo[114744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Flow 'volume_create_manager' (d46e4f64-819a-41b5-8258-4f66109193cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1923206-67ce-46e2-b3ae-381eabdd0560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:39 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Volume volume-72a8b026-caf8-4544-a9d0-6b9514c4d501 (72a8b026-caf8-4544-a9d0-6b9514c4d501): created successfully
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8bbb9a6-367b-4a8f-9b44-64c0251b8ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Flow 'volume_create_manager' (83d84be7-a088-4656-a764-a0cf6b8f5ee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1923206-67ce-46e2-b3ae-381eabdd0560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace959ed-8744-4544-96f5-f19f1bfe726f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b68efa356b54d299d2d7872c623127b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9190a748-4fab-4ffb-a8df-0df34d2ae04e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:39Z,use_quota=True,user_id='0957eb11ffb64e01a4168ea0ac3fbe61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c05bbf-595f-4117-8475-40f5d633b87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c05bbf-595f-4117-8475-40f5d633b87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d33e31d-ad27-4f66-8b4a-bb584d774c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d33e31d-ad27-4f66-8b4a-bb584d774c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ace959ed-8744-4544-96f5-f19f1bfe726f', 'volume_name': 'volume-ace959ed-8744-4544-96f5-f19f1bfe726f', 'volume_size': 1, 'snapshot_id': '9190a748-4fab-4ffb-a8df-0df34d2ae04e'}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0bdbe00-fe6c-4798-8e9e-a2c968061242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0bdbe00-fe6c-4798-8e9e-a2c968061242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (065b3a2b-92c8-4e3f-aa91-4ada637987c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:39 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Volume ace959ed-8744-4544-96f5-f19f1bfe726f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ace959ed-8744-4544-96f5-f19f1bfe726f', 'volume_size': 1, 'snapshot_id': '9190a748-4fab-4ffb-a8df-0df34d2ae04e'}
Jun 26 06:04:39 devstack sudo[114741]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:39 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-78051d6a-d202-48a7-b1d7-90df6f5a11f9 tempest-CreateVolumesFromImageTest-393902001 None] Created volume successfully.
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-10e8167a-3f92-4a22-b533-118cd0e1efe0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.707s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-10e8167a-3f92-4a22-b533-118cd0e1efe0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:39 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-10e8167a-3f92-4a22-b533-118cd0e1efe0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Deleted volume successfully.
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-10e8167a-3f92-4a22-b533-118cd0e1efe0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-22848975-7ed4-4164-8e52-029df2408dd0-delete_volume" released by "delete_volume" :: held 3.152s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e7844e79-f095-4476-a99d-2a4da7ad3fd2 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "cinder-133e21ad-1e5e-4bdd-bc16-a363f59a23f5-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e7844e79-f095-4476-a99d-2a4da7ad3fd2 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-133e21ad-1e5e-4bdd-bc16-a363f59a23f5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e7844e79-f095-4476-a99d-2a4da7ad3fd2 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "cinder-quobyte-133e21ad-1e5e-4bdd-bc16-a363f59a23f5" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e7844e79-f095-4476-a99d-2a4da7ad3fd2 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-quobyte-133e21ad-1e5e-4bdd-bc16-a363f59a23f5" acquired by "delete_volume" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d50afa1-d368-4965-96d2-4ed30c31d0e7]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:39 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e7844e79-f095-4476-a99d-2a4da7ad3fd2 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-133e21ad-1e5e-4bdd-bc16-a363f59a23f5 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:40 devstack sudo[114747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-133e21ad-1e5e-4bdd-bc16-a363f59a23f5
Jun 26 06:04:40 devstack sudo[114747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:40 devstack sudo[114744]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae 1073741824" returned: 0 in 0.897s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:40 devstack sudo[114752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae
Jun 26 06:04:40 devstack sudo[114752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:40 devstack sudo[114747]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e7844e79-f095-4476-a99d-2a4da7ad3fd2 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-133e21ad-1e5e-4bdd-bc16-a363f59a23f5" returned: 0 in 0.796s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e7844e79-f095-4476-a99d-2a4da7ad3fd2 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-133e21ad-1e5e-4bdd-bc16-a363f59a23f5 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:40 devstack sudo[114757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-133e21ad-1e5e-4bdd-bc16-a363f59a23f5
Jun 26 06:04:40 devstack sudo[114757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:40 devstack sudo[114752]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae" returned: 0 in 0.683s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:04:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.409s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-832410223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57504cc-6a1b-4d33-ba8f-4d83b3b1666f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='806d3babf8324c5db1825b45b3848692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:37Z,use_quota=True,user_id='cee13c7642f64c51a1dd2e142344b4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:04:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Creating volume b57504cc-6a1b-4d33-ba8f-4d83b3b1666f {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:04:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:40 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:04:40 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:04:40 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:41 devstack sudo[114760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f 1073741824
Jun 26 06:04:41 devstack sudo[114760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140f49fd-538d-469a-a01d-d48d81ad72d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49ef45f-ad75-498a-bfe2-dbd4a09114df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:41 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Volume volume-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae (e1d6e5a7-aa37-4d9a-9074-4e49429b57ae): created successfully
Jun 26 06:04:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49ef45f-ad75-498a-bfe2-dbd4a09114df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:41 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Flow 'volume_create_manager' (9a6c42eb-12c1-4eda-a238-f88420f8ba24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:41 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-1bf4d0a3-9373-4373-a75d-5d343dac7d0d tempest-CreateVolumesFromImageTest-393902001 None] Created volume successfully.
Jun 26 06:04:41 devstack sudo[114757]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e7844e79-f095-4476-a99d-2a4da7ad3fd2 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-133e21ad-1e5e-4bdd-bc16-a363f59a23f5" returned: 0 in 0.689s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:41 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e7844e79-f095-4476-a99d-2a4da7ad3fd2 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-quobyte-133e21ad-1e5e-4bdd-bc16-a363f59a23f5" released by "delete_volume" :: held 1.531s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:41 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-e7844e79-f095-4476-a99d-2a4da7ad3fd2 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Created reservations ['847207c6-ea73-4aa6-a468-9e080757336b', 'bd2d7e33-1cba-4040-84a1-2b4f4afcd8d6', '5ebe57f0-e33d-482a-9959-0cee315c153b', '2b8daa40-1f27-4351-8b6a-1c43ff99f4e1'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:04:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e7844e79-f095-4476-a99d-2a4da7ad3fd2 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e7844e79-f095-4476-a99d-2a4da7ad3fd2 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e7844e79-f095-4476-a99d-2a4da7ad3fd2 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:41 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-e7844e79-f095-4476-a99d-2a4da7ad3fd2 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-e7844e79-f095-4476-a99d-2a4da7ad3fd2 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e7844e79-f095-4476-a99d-2a4da7ad3fd2 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:41 devstack sudo[114766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:04:41 devstack sudo[114766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:41 devstack sudo[114760]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f 1073741824" returned: 0 in 0.825s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:41 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:41 devstack sudo[114768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f
Jun 26 06:04:41 devstack sudo[114768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1fed3bab-fb8f-4f16-a0ac-fb768e6d9a74 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "cinder-4ba14749-8815-419d-8c30-dd1905b36605-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1fed3bab-fb8f-4f16-a0ac-fb768e6d9a74 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-4ba14749-8815-419d-8c30-dd1905b36605-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1fed3bab-fb8f-4f16-a0ac-fb768e6d9a74 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "cinder-quobyte-4ba14749-8815-419d-8c30-dd1905b36605" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1fed3bab-fb8f-4f16-a0ac-fb768e6d9a74 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-quobyte-4ba14749-8815-419d-8c30-dd1905b36605" acquired by "delete_volume" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f738e8-5093-44f4-a0d7-e655e5867326]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1fed3bab-fb8f-4f16-a0ac-fb768e6d9a74 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4ba14749-8815-419d-8c30-dd1905b36605 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:42 devstack sudo[114766]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-e7844e79-f095-4476-a99d-2a4da7ad3fd2 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.711s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-e7844e79-f095-4476-a99d-2a4da7ad3fd2 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:04:42 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-e7844e79-f095-4476-a99d-2a4da7ad3fd2 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Deleted volume successfully.
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-e7844e79-f095-4476-a99d-2a4da7ad3fd2 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-133e21ad-1e5e-4bdd-bc16-a363f59a23f5-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:42 devstack sudo[114771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4ba14749-8815-419d-8c30-dd1905b36605
Jun 26 06:04:42 devstack sudo[114771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:42 devstack sudo[114768]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f" returned: 0 in 0.708s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.247s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-979919338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04896fbc-45ee-45a7-88bd-1eaa34a6647a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='806d3babf8324c5db1825b45b3848692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:38Z,use_quota=True,user_id='cee13c7642f64c51a1dd2e142344b4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Creating volume 04896fbc-45ee-45a7-88bd-1eaa34a6647a {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:04:42 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-04896fbc-45ee-45a7-88bd-1eaa34a6647a 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:42 devstack sudo[114775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-04896fbc-45ee-45a7-88bd-1eaa34a6647a 1073741824
Jun 26 06:04:42 devstack sudo[114775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b32865a-6060-47a3-83c0-3a2d90dac59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce095305-a90f-4575-9bc0-2a0b31fae51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:42 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Volume volume-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f (b57504cc-6a1b-4d33-ba8f-4d83b3b1666f): created successfully
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce095305-a90f-4575-9bc0-2a0b31fae51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Flow 'volume_create_manager' (fd35b5b8-513a-4779-9e5c-10c5390411d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:42 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-8bcc4ce7-cf84-4d2e-ab64-62f1303fe348 tempest-CreateVolumesFromImageTest-393902001 None] Created volume successfully.
Jun 26 06:04:42 devstack sudo[114771]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1fed3bab-fb8f-4f16-a0ac-fb768e6d9a74 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4ba14749-8815-419d-8c30-dd1905b36605" returned: 0 in 0.762s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:42 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1fed3bab-fb8f-4f16-a0ac-fb768e6d9a74 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4ba14749-8815-419d-8c30-dd1905b36605 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:43 devstack sudo[114781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4ba14749-8815-419d-8c30-dd1905b36605
Jun 26 06:04:43 devstack sudo[114781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:43 devstack sudo[114775]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-04896fbc-45ee-45a7-88bd-1eaa34a6647a 1073741824" returned: 0 in 0.884s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-04896fbc-45ee-45a7-88bd-1eaa34a6647a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:43 devstack sudo[114787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-04896fbc-45ee-45a7-88bd-1eaa34a6647a
Jun 26 06:04:43 devstack sudo[114787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:43 devstack sudo[114781]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1fed3bab-fb8f-4f16-a0ac-fb768e6d9a74 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-4ba14749-8815-419d-8c30-dd1905b36605" returned: 0 in 0.680s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:43 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1fed3bab-fb8f-4f16-a0ac-fb768e6d9a74 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-quobyte-4ba14749-8815-419d-8c30-dd1905b36605" released by "delete_volume" :: held 1.504s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:43 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-1fed3bab-fb8f-4f16-a0ac-fb768e6d9a74 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Created reservations ['39ba02e8-65ae-45b5-8763-afb400c8d9a7', 'e12c829b-fd9c-4e3f-926c-22488e95ced5', '2e7722c5-6f9a-4974-80e8-d660be958ac9', 'be290353-e9fd-41c1-b187-44033d9be463'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:04:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1fed3bab-fb8f-4f16-a0ac-fb768e6d9a74 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1fed3bab-fb8f-4f16-a0ac-fb768e6d9a74 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:43 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-1fed3bab-fb8f-4f16-a0ac-fb768e6d9a74 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:43 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-1fed3bab-fb8f-4f16-a0ac-fb768e6d9a74 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1fed3bab-fb8f-4f16-a0ac-fb768e6d9a74 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:43 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1fed3bab-fb8f-4f16-a0ac-fb768e6d9a74 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:43 devstack sudo[114790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:04:43 devstack sudo[114790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:44 devstack sudo[114787]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-04896fbc-45ee-45a7-88bd-1eaa34a6647a" returned: 0 in 0.671s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.704s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1594899116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b130075f-e184-4a05-9909-dbb4fbaf3d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea1b070700a4ae9af28b14f063af032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:38Z,use_quota=True,user_id='7237cbc6ead94420ab8a2bf378b22480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Creating volume b130075f-e184-4a05-9909-dbb4fbaf3d49 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:04:44 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d262b78-3e91-4c77-9909-7084830ebdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04896fbc-45ee-45a7-88bd-1eaa34a6647a', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86fc8dd5-8ebc-4e67-ba1b-1bfec0b499b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:44 devstack sudo[114793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49 1073741824
Jun 26 06:04:44 devstack sudo[114793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:44 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Volume volume-04896fbc-45ee-45a7-88bd-1eaa34a6647a (04896fbc-45ee-45a7-88bd-1eaa34a6647a): created successfully
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86fc8dd5-8ebc-4e67-ba1b-1bfec0b499b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Flow 'volume_create_manager' (2c4bd775-7714-45dc-8fa7-117589aa95c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:44 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-65bbf548-d1cb-4e25-889f-5224112a9670 tempest-CreateVolumesFromImageTest-393902001 None] Created volume successfully.
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "cinder-d70fb768-24d6-48a6-bf11-974d8b94104d-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-d70fb768-24d6-48a6-bf11-974d8b94104d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "cinder-quobyte-b4d0ec88-3615-4011-89e8-e8ba8e4e0023" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-quobyte-b4d0ec88-3615-4011-89e8-e8ba8e4e0023" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "cinder-quobyte-d70fb768-24d6-48a6-bf11-974d8b94104d" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-quobyte-d70fb768-24d6-48a6-bf11-974d8b94104d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Deleting offline snapshot d70fb768-24d6-48a6-bf11-974d8b94104d of volume b4d0ec88-3615-4011-89e8-e8ba8e4e0023 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] snapshot_file for this snap is: volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.d70fb768-24d6-48a6-bf11-974d8b94104d {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[755a5e71-c719-4897-b68d-b151887f464b]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.d70fb768-24d6-48a6-bf11-974d8b94104d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:44 devstack sudo[114790]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1fed3bab-fb8f-4f16-a0ac-fb768e6d9a74 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.724s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-1fed3bab-fb8f-4f16-a0ac-fb768e6d9a74 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:04:44 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-1fed3bab-fb8f-4f16-a0ac-fb768e6d9a74 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Deleted volume successfully.
Jun 26 06:04:44 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1fed3bab-fb8f-4f16-a0ac-fb768e6d9a74 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-4ba14749-8815-419d-8c30-dd1905b36605-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:44 devstack sudo[114796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.d70fb768-24d6-48a6-bf11-974d8b94104d
Jun 26 06:04:44 devstack sudo[114796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:45 devstack sudo[114793]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49 1073741824" returned: 0 in 0.897s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:45 devstack sudo[114803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49
Jun 26 06:04:45 devstack sudo[114803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:45 devstack sudo[114796]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.d70fb768-24d6-48a6-bf11-974d8b94104d" returned: 0 in 0.845s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3c9251-98f1-40c5-a375-31497b2a3aec]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:45 devstack sudo[114806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023
Jun 26 06:04:45 devstack sudo[114806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:45 devstack sudo[114803]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49" returned: 0 in 0.664s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.249s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-717857566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b52ff3d-c086-42bc-8972-ed43772e4cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='806d3babf8324c5db1825b45b3848692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:38Z,use_quota=True,user_id='cee13c7642f64c51a1dd2e142344b4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Creating volume 0b52ff3d-c086-42bc-8972-ed43772e4cb8 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:04:45 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b52ff3d-c086-42bc-8972-ed43772e4cb8 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:45 devstack sudo[114809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b52ff3d-c086-42bc-8972-ed43772e4cb8 1073741824
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f463987b-d3ee-41b2-819c-1bdb852b55d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b130075f-e184-4a05-9909-dbb4fbaf3d49', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:45 devstack sudo[114809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1971dfc-409c-4e97-99b9-144cb9593dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:45 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Volume volume-b130075f-e184-4a05-9909-dbb4fbaf3d49 (b130075f-e184-4a05-9909-dbb4fbaf3d49): created successfully
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1971dfc-409c-4e97-99b9-144cb9593dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:45 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Flow 'volume_create_manager' (995556ef-1a3e-4f0c-ab6c-636b51ab91dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:45 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-cdb467a6-b359-4ccf-975a-fb7cd1635c45 tempest-VolumeDependencyTests-1196851174 None] Created volume successfully.
Jun 26 06:04:46 devstack sudo[114806]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023" returned: 0 in 0.773s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.d70fb768-24d6-48a6-bf11-974d8b94104d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:46 devstack sudo[114814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.d70fb768-24d6-48a6-bf11-974d8b94104d
Jun 26 06:04:46 devstack sudo[114814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-642c3535-be33-41b8-8389-91af29a70350 tempest-VolumeDependencyTests-1196851174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:46 devstack sudo[114809]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b52ff3d-c086-42bc-8972-ed43772e4cb8 1073741824" returned: 0 in 0.924s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b52ff3d-c086-42bc-8972-ed43772e4cb8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:46 devstack sudo[114825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b52ff3d-c086-42bc-8972-ed43772e4cb8
Jun 26 06:04:46 devstack sudo[114825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:46 devstack sudo[114814]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.d70fb768-24d6-48a6-bf11-974d8b94104d" returned: 0 in 0.841s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:46 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.d70fb768-24d6-48a6-bf11-974d8b94104d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:46 devstack sudo[114827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.d70fb768-24d6-48a6-bf11-974d8b94104d
Jun 26 06:04:46 devstack sudo[114827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:47 devstack sudo[114825]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b52ff3d-c086-42bc-8972-ed43772e4cb8" returned: 0 in 0.663s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.934s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Acquiring lock "cinder-quobyte-9190a748-4fab-4ffb-a8df-0df34d2ae04e-ace959ed-8744-4544-96f5-f19f1bfe726f" by "_create_volume_from_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984d6d3e-7b0b-4f92-a43e-f1648f80c635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b52ff3d-c086-42bc-8972-ed43772e4cb8', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36c7d8d-9a28-480a-9b45-1ffeb36304b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Lock "cinder-quobyte-9190a748-4fab-4ffb-a8df-0df34d2ae04e-ace959ed-8744-4544-96f5-f19f1bfe726f" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Creating volume ace959ed-8744-4544-96f5-f19f1bfe726f from snapshot 9190a748-4fab-4ffb-a8df-0df34d2ae04e {{(pid=93708) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Acquiring lock "cinder-quobyte-ace959ed-8744-4544-96f5-f19f1bfe726f" by "_copy_volume_from_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:47 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Volume volume-0b52ff3d-c086-42bc-8972-ed43772e4cb8 (0b52ff3d-c086-42bc-8972-ed43772e4cb8): created successfully
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36c7d8d-9a28-480a-9b45-1ffeb36304b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Flow 'volume_create_manager' (894e3916-ad16-4795-90a1-6f2508311e7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Lock "cinder-quobyte-ace959ed-8744-4544-96f5-f19f1bfe726f" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] snapshot: 9190a748-4fab-4ffb-a8df-0df34d2ae04e, volume: ace959ed-8744-4544-96f5-f19f1bfe726f,  {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 06:04:47 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-29fa7d65-68bb-45c3-8ae1-4dc50f13562d tempest-CreateVolumesFromImageTest-393902001 None] Created volume successfully.
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0414073-ee30-4490-994b-0e39a23e60b8]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:47 devstack sudo[114827]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023.d70fb768-24d6-48a6-bf11-974d8b94104d" returned: 0 in 0.689s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-quobyte-d70fb768-24d6-48a6-bf11-974d8b94104d" released by "_delete_snapshot" :: held 3.254s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-quobyte-b4d0ec88-3615-4011-89e8-e8ba8e4e0023" released by "delete_snapshot" :: held 3.281s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:47 devstack sudo[114831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e
Jun 26 06:04:47 devstack sudo[114831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Created reservations ['b65215e3-04e0-457f-8f5a-cc089ec51f65', '5e0cf799-a91b-4aa3-9311-eb2860e2c44f', '8b3a3a23-9be1-4365-9650-6a4903842ce5', 'b3ac089e-320d-4037-80b9-4ca11534a226'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:04:47 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Delete snapshot completed successfully.
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-ee438ec8-1d03-47c9-8579-d7869b7861d0 tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-d70fb768-24d6-48a6-bf11-974d8b94104d-delete_snapshot" released by "delete_snapshot" :: held 3.448s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-722f67c1-e009-4f60-916a-f28565509c4e tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "cinder-0b52ff3d-c086-42bc-8972-ed43772e4cb8-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-722f67c1-e009-4f60-916a-f28565509c4e tempest-CreateVolumesFromImageTest-393902001 None] Lock "cinder-0b52ff3d-c086-42bc-8972-ed43772e4cb8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-722f67c1-e009-4f60-916a-f28565509c4e tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "cinder-quobyte-0b52ff3d-c086-42bc-8972-ed43772e4cb8" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-722f67c1-e009-4f60-916a-f28565509c4e tempest-CreateVolumesFromImageTest-393902001 None] Lock "cinder-quobyte-0b52ff3d-c086-42bc-8972-ed43772e4cb8" acquired by "delete_volume" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a3ab6d-6663-40b2-80a4-5bf20a5aaea1]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:47 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-722f67c1-e009-4f60-916a-f28565509c4e tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b52ff3d-c086-42bc-8972-ed43772e4cb8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:47 devstack sudo[114833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b52ff3d-c086-42bc-8972-ed43772e4cb8
Jun 26 06:04:48 devstack sudo[114833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:48 devstack sudo[114831]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e" returned: 0 in 0.770s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:48 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 06:04:48 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 06:04:48 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Creating direct copy from snapshot {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 06:04:48 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[783fd92e-b021-4b6e-a6bc-6234341c42cf]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:48 devstack sudo[114838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b
Jun 26 06:04:48 devstack sudo[114838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:48 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-41341ce9-f839-415a-ae0b-2db48653578f tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "cinder-b4d0ec88-3615-4011-89e8-e8ba8e4e0023-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:48 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-41341ce9-f839-415a-ae0b-2db48653578f tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-b4d0ec88-3615-4011-89e8-e8ba8e4e0023-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:48 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-41341ce9-f839-415a-ae0b-2db48653578f tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "cinder-quobyte-b4d0ec88-3615-4011-89e8-e8ba8e4e0023" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:48 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-41341ce9-f839-415a-ae0b-2db48653578f tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-quobyte-b4d0ec88-3615-4011-89e8-e8ba8e4e0023" acquired by "delete_volume" :: waited 0.015s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:48 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df95510-43fe-46ad-a9b8-9620b8efe544]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-41341ce9-f839-415a-ae0b-2db48653578f tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:48 devstack sudo[114833]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-722f67c1-e009-4f60-916a-f28565509c4e tempest-CreateVolumesFromImageTest-393902001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b52ff3d-c086-42bc-8972-ed43772e4cb8" returned: 0 in 0.828s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:48 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-722f67c1-e009-4f60-916a-f28565509c4e tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b52ff3d-c086-42bc-8972-ed43772e4cb8 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:48 devstack sudo[114844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b52ff3d-c086-42bc-8972-ed43772e4cb8
Jun 26 06:04:48 devstack sudo[114844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:48 devstack sudo[114843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023
Jun 26 06:04:48 devstack sudo[114843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:49 devstack sudo[114838]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b" returned: 0 in 0.821s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:49 devstack cinder-volume[93708]: DEBUG cinder.utils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Path /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ace959ed-8744-4544-96f5-f19f1bfe726f not found in is_blk_device check {{(pid=93708) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 06:04:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ace959ed-8744-4544-96f5-f19f1bfe726f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:49 devstack sudo[114850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ace959ed-8744-4544-96f5-f19f1bfe726f
Jun 26 06:04:49 devstack sudo[114850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:49 devstack sudo[114844]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-722f67c1-e009-4f60-916a-f28565509c4e tempest-CreateVolumesFromImageTest-393902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-0b52ff3d-c086-42bc-8972-ed43772e4cb8" returned: 0 in 0.744s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:49 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-722f67c1-e009-4f60-916a-f28565509c4e tempest-CreateVolumesFromImageTest-393902001 None] Lock "cinder-quobyte-0b52ff3d-c086-42bc-8972-ed43772e4cb8" released by "delete_volume" :: held 1.617s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:49 devstack sudo[114843]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-41341ce9-f839-415a-ae0b-2db48653578f tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023" returned: 0 in 0.793s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-41341ce9-f839-415a-ae0b-2db48653578f tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:49 devstack sudo[114856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023
Jun 26 06:04:49 devstack sudo[114856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:49 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-722f67c1-e009-4f60-916a-f28565509c4e tempest-CreateVolumesFromImageTest-393902001 None] Created reservations ['c5f56588-96db-478e-8554-c6bb9217efeb', '902d38f8-0be3-48fe-9dc7-509817036664', '866aeedd-1062-474b-9593-f9a3bc9b56d5', 'e9451826-e0d5-497d-a22f-24343793e98a'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:04:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-722f67c1-e009-4f60-916a-f28565509c4e tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-722f67c1-e009-4f60-916a-f28565509c4e tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:49 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-722f67c1-e009-4f60-916a-f28565509c4e tempest-CreateVolumesFromImageTest-393902001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:49 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-722f67c1-e009-4f60-916a-f28565509c4e tempest-CreateVolumesFromImageTest-393902001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-722f67c1-e009-4f60-916a-f28565509c4e tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:49 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-722f67c1-e009-4f60-916a-f28565509c4e tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:49 devstack sudo[114858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:04:49 devstack sudo[114858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:50 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-97b11f4f-fa24-4b19-948f-bc996979e2a6 tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "cinder-04896fbc-45ee-45a7-88bd-1eaa34a6647a-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:50 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-97b11f4f-fa24-4b19-948f-bc996979e2a6 tempest-CreateVolumesFromImageTest-393902001 None] Lock "cinder-04896fbc-45ee-45a7-88bd-1eaa34a6647a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:50 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-97b11f4f-fa24-4b19-948f-bc996979e2a6 tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "cinder-quobyte-04896fbc-45ee-45a7-88bd-1eaa34a6647a" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:50 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-97b11f4f-fa24-4b19-948f-bc996979e2a6 tempest-CreateVolumesFromImageTest-393902001 None] Lock "cinder-quobyte-04896fbc-45ee-45a7-88bd-1eaa34a6647a" acquired by "delete_volume" :: waited 0.066s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:50 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4be6c36-7cf8-46c6-9ab2-c8209ea63a22]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-97b11f4f-fa24-4b19-948f-bc996979e2a6 tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-04896fbc-45ee-45a7-88bd-1eaa34a6647a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:50 devstack sudo[114856]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-41341ce9-f839-415a-ae0b-2db48653578f tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b4d0ec88-3615-4011-89e8-e8ba8e4e0023" returned: 0 in 1.003s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:50 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-41341ce9-f839-415a-ae0b-2db48653578f tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-quobyte-b4d0ec88-3615-4011-89e8-e8ba8e4e0023" released by "delete_volume" :: held 1.879s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:50 devstack sudo[114871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-04896fbc-45ee-45a7-88bd-1eaa34a6647a
Jun 26 06:04:50 devstack sudo[114871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:50 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-41341ce9-f839-415a-ae0b-2db48653578f tempest-CreateVolumesFromSnapshotTest-1424569728 None] Created reservations ['02af27e6-5b11-4146-8ab1-a5b6a2c87da9', '4998d5b1-f8e5-4611-b9e5-5b953636b7c2', '4ee18af7-27b1-446e-9e34-b5912e637a4d', 'c92c7087-cc6b-4884-883c-058a33a62810'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:04:50 devstack sudo[114858]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:50 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-722f67c1-e009-4f60-916a-f28565509c4e tempest-CreateVolumesFromImageTest-393902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.178s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:50 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-722f67c1-e009-4f60-916a-f28565509c4e tempest-CreateVolumesFromImageTest-393902001 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:04:50 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-722f67c1-e009-4f60-916a-f28565509c4e tempest-CreateVolumesFromImageTest-393902001 None] Deleted volume successfully.
Jun 26 06:04:50 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-722f67c1-e009-4f60-916a-f28565509c4e tempest-CreateVolumesFromImageTest-393902001 None] Lock "cinder-0b52ff3d-c086-42bc-8972-ed43772e4cb8-delete_volume" released by "delete_volume" :: held 3.079s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-41341ce9-f839-415a-ae0b-2db48653578f tempest-CreateVolumesFromSnapshotTest-1424569728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-41341ce9-f839-415a-ae0b-2db48653578f tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-41341ce9-f839-415a-ae0b-2db48653578f tempest-CreateVolumesFromSnapshotTest-1424569728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:51 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-41341ce9-f839-415a-ae0b-2db48653578f tempest-CreateVolumesFromSnapshotTest-1424569728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-41341ce9-f839-415a-ae0b-2db48653578f tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:51 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-41341ce9-f839-415a-ae0b-2db48653578f tempest-CreateVolumesFromSnapshotTest-1424569728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:51 devstack sudo[114874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:04:51 devstack sudo[114874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:52 devstack sudo[114871]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-97b11f4f-fa24-4b19-948f-bc996979e2a6 tempest-CreateVolumesFromImageTest-393902001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-04896fbc-45ee-45a7-88bd-1eaa34a6647a" returned: 0 in 2.266s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-97b11f4f-fa24-4b19-948f-bc996979e2a6 tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-04896fbc-45ee-45a7-88bd-1eaa34a6647a {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:52 devstack sudo[114874]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:52 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-41341ce9-f839-415a-ae0b-2db48653578f tempest-CreateVolumesFromSnapshotTest-1424569728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.631s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:52 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-41341ce9-f839-415a-ae0b-2db48653578f tempest-CreateVolumesFromSnapshotTest-1424569728 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:04:52 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-41341ce9-f839-415a-ae0b-2db48653578f tempest-CreateVolumesFromSnapshotTest-1424569728 None] Deleted volume successfully.
Jun 26 06:04:52 devstack sudo[114882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-04896fbc-45ee-45a7-88bd-1eaa34a6647a
Jun 26 06:04:52 devstack sudo[114882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:52 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-41341ce9-f839-415a-ae0b-2db48653578f tempest-CreateVolumesFromSnapshotTest-1424569728 None] Lock "cinder-b4d0ec88-3615-4011-89e8-e8ba8e4e0023-delete_volume" released by "delete_volume" :: held 4.134s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:54 devstack sudo[114882]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-97b11f4f-fa24-4b19-948f-bc996979e2a6 tempest-CreateVolumesFromImageTest-393902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-04896fbc-45ee-45a7-88bd-1eaa34a6647a" returned: 0 in 1.845s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:54 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-97b11f4f-fa24-4b19-948f-bc996979e2a6 tempest-CreateVolumesFromImageTest-393902001 None] Lock "cinder-quobyte-04896fbc-45ee-45a7-88bd-1eaa34a6647a" released by "delete_volume" :: held 4.221s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:54 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=189,cinder:SELECT=133,cinder:INSERT=49,cinder:DELETE=18 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 06:04:54 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-97b11f4f-fa24-4b19-948f-bc996979e2a6 tempest-CreateVolumesFromImageTest-393902001 None] Created reservations ['cf67d368-cf3e-4708-910c-4f88a99418e7', '87b7aa55-36a6-4eca-a21c-8145b0bf2336', '4c339534-2a59-40e3-bec6-e241cc159bcd', '8d4c4579-7764-4c43-89b3-0f7554d54654'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:04:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-97b11f4f-fa24-4b19-948f-bc996979e2a6 tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-97b11f4f-fa24-4b19-948f-bc996979e2a6 tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-97b11f4f-fa24-4b19-948f-bc996979e2a6 tempest-CreateVolumesFromImageTest-393902001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:54 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-97b11f4f-fa24-4b19-948f-bc996979e2a6 tempest-CreateVolumesFromImageTest-393902001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-97b11f4f-fa24-4b19-948f-bc996979e2a6 tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:54 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-97b11f4f-fa24-4b19-948f-bc996979e2a6 tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:54 devstack sudo[114885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:04:54 devstack sudo[114885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9bb05f20-363c-4a44-89a5-de00a5d05528 tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "cinder-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9bb05f20-363c-4a44-89a5-de00a5d05528 tempest-CreateVolumesFromImageTest-393902001 None] Lock "cinder-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:55 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=139,cinder:UPDATE=190,cinder:DELETE=18,cinder:INSERT=47 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 06:04:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9bb05f20-363c-4a44-89a5-de00a5d05528 tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "cinder-quobyte-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9bb05f20-363c-4a44-89a5-de00a5d05528 tempest-CreateVolumesFromImageTest-393902001 None] Lock "cinder-quobyte-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f" acquired by "delete_volume" :: waited 0.033s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:55 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[47129d21-35f7-4b26-aaab-3be51a905764]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9bb05f20-363c-4a44-89a5-de00a5d05528 tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:55 devstack sudo[114850]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ace959ed-8744-4544-96f5-f19f1bfe726f" returned: 0 in 6.264s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:55 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[772b8172-1270-44bb-a5a9-dcfd8dd911eb]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:55 devstack sudo[114887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f
Jun 26 06:04:55 devstack sudo[114887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:55 devstack sudo[114888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b
Jun 26 06:04:55 devstack sudo[114888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:55 devstack sudo[114885]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:55 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-97b11f4f-fa24-4b19-948f-bc996979e2a6 tempest-CreateVolumesFromImageTest-393902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.111s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:55 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-97b11f4f-fa24-4b19-948f-bc996979e2a6 tempest-CreateVolumesFromImageTest-393902001 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:04:55 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-97b11f4f-fa24-4b19-948f-bc996979e2a6 tempest-CreateVolumesFromImageTest-393902001 None] Deleted volume successfully.
Jun 26 06:04:55 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-97b11f4f-fa24-4b19-948f-bc996979e2a6 tempest-CreateVolumesFromImageTest-393902001 None] Lock "cinder-04896fbc-45ee-45a7-88bd-1eaa34a6647a-delete_volume" released by "delete_volume" :: held 5.799s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:56 devstack sudo[114887]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9bb05f20-363c-4a44-89a5-de00a5d05528 tempest-CreateVolumesFromImageTest-393902001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f" returned: 0 in 0.833s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9bb05f20-363c-4a44-89a5-de00a5d05528 tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:56 devstack sudo[114897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f
Jun 26 06:04:56 devstack sudo[114897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:56 devstack sudo[114888]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b" returned: 0 in 1.094s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:56 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Image conversion details: src /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b, size 1024.00 MB, duration 6.27 sec, destination /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ace959ed-8744-4544-96f5-f19f1bfe726f {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 06:04:56 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Converted 1024.00 MB image at 163.43 MB/s
Jun 26 06:04:56 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ace959ed-8744-4544-96f5-f19f1bfe726f is being set with open permissions: ugo+rw
Jun 26 06:04:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ace959ed-8744-4544-96f5-f19f1bfe726f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:56 devstack sudo[114900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ace959ed-8744-4544-96f5-f19f1bfe726f
Jun 26 06:04:56 devstack sudo[114900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:56 devstack sudo[114897]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:56 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9bb05f20-363c-4a44-89a5-de00a5d05528 tempest-CreateVolumesFromImageTest-393902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f" returned: 0 in 0.707s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:56 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9bb05f20-363c-4a44-89a5-de00a5d05528 tempest-CreateVolumesFromImageTest-393902001 None] Lock "cinder-quobyte-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f" released by "delete_volume" :: held 1.591s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-9bb05f20-363c-4a44-89a5-de00a5d05528 tempest-CreateVolumesFromImageTest-393902001 None] Created reservations ['5e8c771d-f7c8-42b0-b2a0-3f56977cd157', '4e2f2059-5fba-49bb-b985-1b32b8a7efde', 'b76098f0-f879-425c-892a-725f36be2417', '43e719dd-6987-40de-96e2-05a32ac2e7ac'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9bb05f20-363c-4a44-89a5-de00a5d05528 tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9bb05f20-363c-4a44-89a5-de00a5d05528 tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9bb05f20-363c-4a44-89a5-de00a5d05528 tempest-CreateVolumesFromImageTest-393902001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-9bb05f20-363c-4a44-89a5-de00a5d05528 tempest-CreateVolumesFromImageTest-393902001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-9bb05f20-363c-4a44-89a5-de00a5d05528 tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9bb05f20-363c-4a44-89a5-de00a5d05528 tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:57 devstack sudo[114903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:04:57 devstack sudo[114903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Flow 'volume_create_manager' (a4019b9c-23c7-45c5-89d5-17b4241f77de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ea3286-03aa-4a46-93eb-2db3c3fc74c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ea3286-03aa-4a46-93eb-2db3c3fc74c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d60fba-2f4e-445a-b8b9-0e88db4f35e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79d2061a7054d2c8a31a78d6802b72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:57Z,use_quota=True,user_id='911fb454f9984306b54ff5e7e2675af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62cd670b-f15d-4302-ba8a-72ddd8282e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62cd670b-f15d-4302-ba8a-72ddd8282e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089f6930-42a0-4b8f-b198-401fff1d4cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089f6930-42a0-4b8f-b198-401fff1d4cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d60fba-2f4e-445a-b8b9-0e88db4f35e5', 'volume_name': 'volume-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fee5892-e7ca-4515-84a6-cf0944149d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:57 devstack sudo[114900]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fee5892-e7ca-4515-84a6-cf0944149d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9b66df-87e9-411d-8a50-66a75127aca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:57 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Volume e9d60fba-2f4e-445a-b8b9-0e88db4f35e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5', 'volume_size': 1}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ace959ed-8744-4544-96f5-f19f1bfe726f" returned: 0 in 0.741s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Lock "cinder-quobyte-ace959ed-8744-4544-96f5-f19f1bfe726f" released by "_copy_volume_from_snapshot" :: held 9.812s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Lock "cinder-quobyte-9190a748-4fab-4ffb-a8df-0df34d2ae04e-ace959ed-8744-4544-96f5-f19f1bfe726f" released by "_create_volume_from_snapshot" :: held 9.857s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.905s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-642c3535-be33-41b8-8389-91af29a70350 tempest-VolumeDependencyTests-1196851174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.798s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-642c3535-be33-41b8-8389-91af29a70350 tempest-VolumeDependencyTests-1196851174 None] Creating offline snapshot 70bce8f6-5702-430c-bd96-d808ae18ffda of volume b130075f-e184-4a05-9909-dbb4fbaf3d49 {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (065b3a2b-92c8-4e3f-aa91-4ada637987c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ace959ed-8744-4544-96f5-f19f1bfe726f', 'volume_size': 1, 'snapshot_id': '9190a748-4fab-4ffb-a8df-0df34d2ae04e'}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7361e45e-9134-4ab6-9bdf-5b977a78d6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[43002019-05c6-4aa6-84ed-7e8e16b156d9]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-642c3535-be33-41b8-8389-91af29a70350 tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:57 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Volume volume-ace959ed-8744-4544-96f5-f19f1bfe726f (ace959ed-8744-4544-96f5-f19f1bfe726f): created successfully
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7361e45e-9134-4ab6-9bdf-5b977a78d6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Flow 'volume_create_manager' (d46e4f64-819a-41b5-8258-4f66109193cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:04:57 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-a3a6e291-a068-4a7e-972d-acdfbf4b23f9 tempest-SnapshotDependencyTests-1278970603 None] Created volume successfully.
Jun 26 06:04:57 devstack sudo[114906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49
Jun 26 06:04:57 devstack sudo[114906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-287d652c-dba3-417d-b306-97aee1d964c2 tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "cinder-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-287d652c-dba3-417d-b306-97aee1d964c2 tempest-CreateVolumesFromImageTest-393902001 None] Lock "cinder-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-287d652c-dba3-417d-b306-97aee1d964c2 tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "cinder-quobyte-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-287d652c-dba3-417d-b306-97aee1d964c2 tempest-CreateVolumesFromImageTest-393902001 None] Lock "cinder-quobyte-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae" acquired by "delete_volume" :: waited 0.031s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[1475f8b2-5d8c-4ae7-a0d6-f735cfc5754e]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-287d652c-dba3-417d-b306-97aee1d964c2 tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:57 devstack sudo[114903]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:57 devstack sudo[114909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae
Jun 26 06:04:57 devstack sudo[114909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-9bb05f20-363c-4a44-89a5-de00a5d05528 tempest-CreateVolumesFromImageTest-393902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.697s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-9bb05f20-363c-4a44-89a5-de00a5d05528 tempest-CreateVolumesFromImageTest-393902001 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:04:57 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-9bb05f20-363c-4a44-89a5-de00a5d05528 tempest-CreateVolumesFromImageTest-393902001 None] Deleted volume successfully.
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-9bb05f20-363c-4a44-89a5-de00a5d05528 tempest-CreateVolumesFromImageTest-393902001 None] Lock "cinder-b57504cc-6a1b-4d33-ba8f-4d83b3b1666f-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] Acquiring lock "cinder-9190a748-4fab-4ffb-a8df-0df34d2ae04e-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] Lock "cinder-9190a748-4fab-4ffb-a8df-0df34d2ae04e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] Acquiring lock "cinder-quobyte-eba791b6-b5cb-4890-9b46-8c0453a1aa0b" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] Lock "cinder-quobyte-eba791b6-b5cb-4890-9b46-8c0453a1aa0b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] Acquiring lock "cinder-quobyte-9190a748-4fab-4ffb-a8df-0df34d2ae04e" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] Lock "cinder-quobyte-9190a748-4fab-4ffb-a8df-0df34d2ae04e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] Deleting offline snapshot 9190a748-4fab-4ffb-a8df-0df34d2ae04e of volume eba791b6-b5cb-4890-9b46-8c0453a1aa0b {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] snapshot_file for this snap is: volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35b3708-612a-43e2-8698-e9264b266994]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:57 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:58 devstack sudo[114911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e
Jun 26 06:04:58 devstack sudo[114911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:58 devstack sudo[114906]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-642c3535-be33-41b8-8389-91af29a70350 tempest-VolumeDependencyTests-1196851174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49" returned: 0 in 0.888s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-642c3535-be33-41b8-8389-91af29a70350 tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:58 devstack sudo[114916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda 1G
Jun 26 06:04:58 devstack sudo[114916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:58 devstack sudo[114909]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-287d652c-dba3-417d-b306-97aee1d964c2 tempest-CreateVolumesFromImageTest-393902001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae" returned: 0 in 0.783s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-287d652c-dba3-417d-b306-97aee1d964c2 tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:58 devstack sudo[114921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae
Jun 26 06:04:58 devstack sudo[114921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:58 devstack sudo[114911]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e" returned: 0 in 0.824s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:58 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 06:04:58 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb6f6b5-4094-4ef4-8bec-10ea357ffe26]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:58 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:58 devstack sudo[114929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b
Jun 26 06:04:58 devstack sudo[114929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:59 devstack sudo[114916]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-642c3535-be33-41b8-8389-91af29a70350 tempest-VolumeDependencyTests-1196851174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda 1G" returned: 0 in 0.794s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-642c3535-be33-41b8-8389-91af29a70350 tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b130075f-e184-4a05-9909-dbb4fbaf3d49 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:59 devstack sudo[114932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b130075f-e184-4a05-9909-dbb4fbaf3d49 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda
Jun 26 06:04:59 devstack sudo[114932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:59 devstack sudo[114921]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-287d652c-dba3-417d-b306-97aee1d964c2 tempest-CreateVolumesFromImageTest-393902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae" returned: 0 in 0.742s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:59 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-287d652c-dba3-417d-b306-97aee1d964c2 tempest-CreateVolumesFromImageTest-393902001 None] Lock "cinder-quobyte-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae" released by "delete_volume" :: held 1.594s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:04:59 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-287d652c-dba3-417d-b306-97aee1d964c2 tempest-CreateVolumesFromImageTest-393902001 None] Created reservations ['fcf002f7-2733-4574-b2c7-4626eeaa3944', 'e770888b-47af-4502-ac2e-f178d9ccd9f7', 'd00a6ac2-10b1-4148-a89f-07ff90b26408', 'd5ed3873-f29d-4f46-b2c7-051792a6a663'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:04:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-287d652c-dba3-417d-b306-97aee1d964c2 tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:04:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-287d652c-dba3-417d-b306-97aee1d964c2 tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:04:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-287d652c-dba3-417d-b306-97aee1d964c2 tempest-CreateVolumesFromImageTest-393902001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:04:59 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-287d652c-dba3-417d-b306-97aee1d964c2 tempest-CreateVolumesFromImageTest-393902001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:04:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-287d652c-dba3-417d-b306-97aee1d964c2 tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:04:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-287d652c-dba3-417d-b306-97aee1d964c2 tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:59 devstack sudo[114935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:04:59 devstack sudo[114935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:59 devstack sudo[114929]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b" returned: 0 in 0.801s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:59 devstack sudo[114943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e
Jun 26 06:04:59 devstack sudo[114943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:59 devstack sudo[114932]: pam_unix(sudo:session): session closed for user root
Jun 26 06:04:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-642c3535-be33-41b8-8389-91af29a70350 tempest-VolumeDependencyTests-1196851174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b130075f-e184-4a05-9909-dbb4fbaf3d49 -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda" returned: 0 in 0.677s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:04:59 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-642c3535-be33-41b8-8389-91af29a70350 tempest-VolumeDependencyTests-1196851174 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda is being set with open permissions: ugo+rw
Jun 26 06:04:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-642c3535-be33-41b8-8389-91af29a70350 tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:04:59 devstack sudo[114945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda
Jun 26 06:04:59 devstack sudo[114945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:04:59 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a4002d63-9510-4dfd-9159-692c50381b94 tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "cinder-72a8b026-caf8-4544-a9d0-6b9514c4d501-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:59 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a4002d63-9510-4dfd-9159-692c50381b94 tempest-CreateVolumesFromImageTest-393902001 None] Lock "cinder-72a8b026-caf8-4544-a9d0-6b9514c4d501-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:59 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a4002d63-9510-4dfd-9159-692c50381b94 tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "cinder-quobyte-72a8b026-caf8-4544-a9d0-6b9514c4d501" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:04:59 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a4002d63-9510-4dfd-9159-692c50381b94 tempest-CreateVolumesFromImageTest-393902001 None] Lock "cinder-quobyte-72a8b026-caf8-4544-a9d0-6b9514c4d501" acquired by "delete_volume" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:04:59 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5d4da4-7e3b-41e9-9cf5-31b94023293f]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:04:59 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a4002d63-9510-4dfd-9159-692c50381b94 tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-72a8b026-caf8-4544-a9d0-6b9514c4d501 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:00 devstack sudo[114935]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-287d652c-dba3-417d-b306-97aee1d964c2 tempest-CreateVolumesFromImageTest-393902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.701s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:00 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-287d652c-dba3-417d-b306-97aee1d964c2 tempest-CreateVolumesFromImageTest-393902001 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:05:00 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-287d652c-dba3-417d-b306-97aee1d964c2 tempest-CreateVolumesFromImageTest-393902001 None] Deleted volume successfully.
Jun 26 06:05:00 devstack sudo[114948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-72a8b026-caf8-4544-a9d0-6b9514c4d501
Jun 26 06:05:00 devstack sudo[114948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:00 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-287d652c-dba3-417d-b306-97aee1d964c2 tempest-CreateVolumesFromImageTest-393902001 None] Lock "cinder-e1d6e5a7-aa37-4d9a-9074-4e49429b57ae-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:00 devstack sudo[114943]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e" returned: 0 in 0.846s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:00 devstack sudo[114955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e
Jun 26 06:05:00 devstack sudo[114955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:00 devstack sudo[114945]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-642c3535-be33-41b8-8389-91af29a70350 tempest-VolumeDependencyTests-1196851174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda" returned: 0 in 0.825s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-642c3535-be33-41b8-8389-91af29a70350 tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:00 devstack sudo[114957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.info
Jun 26 06:05:00 devstack sudo[114957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:00 devstack sudo[114948]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a4002d63-9510-4dfd-9159-692c50381b94 tempest-CreateVolumesFromImageTest-393902001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-72a8b026-caf8-4544-a9d0-6b9514c4d501" returned: 0 in 0.786s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:00 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a4002d63-9510-4dfd-9159-692c50381b94 tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-72a8b026-caf8-4544-a9d0-6b9514c4d501 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:00 devstack sudo[114962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-72a8b026-caf8-4544-a9d0-6b9514c4d501
Jun 26 06:05:00 devstack sudo[114962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:01 devstack sudo[114955]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b.9190a748-4fab-4ffb-a8df-0df34d2ae04e" returned: 0 in 0.692s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:01 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] Lock "cinder-quobyte-9190a748-4fab-4ffb-a8df-0df34d2ae04e" released by "_delete_snapshot" :: held 3.271s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:01 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] Lock "cinder-quobyte-eba791b6-b5cb-4890-9b46-8c0453a1aa0b" released by "delete_snapshot" :: held 3.301s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:01 devstack sudo[114957]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-642c3535-be33-41b8-8389-91af29a70350 tempest-VolumeDependencyTests-1196851174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.info" returned: 0 in 0.693s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:01 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-642c3535-be33-41b8-8389-91af29a70350 tempest-VolumeDependencyTests-1196851174 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.info is being set with open permissions: ugo+rw
Jun 26 06:05:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-642c3535-be33-41b8-8389-91af29a70350 tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:01 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] Created reservations ['83dfb0a6-aefb-47c9-ac7f-f56a5c943e99', '3241d8c2-8c5a-4fcc-837c-f3b17e537c9d', '6f54f46c-30de-44e0-9a6d-7b15c70d4f91', 'e6e00643-b3e1-4385-a5e2-629f8870c9d0'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:05:01 devstack sudo[114972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.info
Jun 26 06:05:01 devstack sudo[114972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:01 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] Delete snapshot completed successfully.
Jun 26 06:05:01 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-630932e6-49e3-4dff-b492-a308758e9fbe tempest-SnapshotDependencyTests-1278970603 None] Lock "cinder-9190a748-4fab-4ffb-a8df-0df34d2ae04e-delete_snapshot" released by "delete_snapshot" :: held 3.486s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:01 devstack sudo[114962]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a4002d63-9510-4dfd-9159-692c50381b94 tempest-CreateVolumesFromImageTest-393902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-72a8b026-caf8-4544-a9d0-6b9514c4d501" returned: 0 in 0.725s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:01 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a4002d63-9510-4dfd-9159-692c50381b94 tempest-CreateVolumesFromImageTest-393902001 None] Lock "cinder-quobyte-72a8b026-caf8-4544-a9d0-6b9514c4d501" released by "delete_volume" :: held 1.559s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:01 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-a4002d63-9510-4dfd-9159-692c50381b94 tempest-CreateVolumesFromImageTest-393902001 None] Created reservations ['545f3f14-06a5-465a-b39e-4d5565363043', '86d5312c-7d0c-4e42-acc0-62b8a393d0ae', 'ba2475f9-b30c-42ef-b412-691693a5a5e7', '03c24e51-e0ca-48b3-a861-f3e90d94ce5e'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:05:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a4002d63-9510-4dfd-9159-692c50381b94 tempest-CreateVolumesFromImageTest-393902001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:05:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a4002d63-9510-4dfd-9159-692c50381b94 tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:05:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a4002d63-9510-4dfd-9159-692c50381b94 tempest-CreateVolumesFromImageTest-393902001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:05:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-a4002d63-9510-4dfd-9159-692c50381b94 tempest-CreateVolumesFromImageTest-393902001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:05:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-a4002d63-9510-4dfd-9159-692c50381b94 tempest-CreateVolumesFromImageTest-393902001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:05:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a4002d63-9510-4dfd-9159-692c50381b94 tempest-CreateVolumesFromImageTest-393902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:01 devstack sudo[114976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:05:01 devstack sudo[114976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:01 devstack sudo[114972]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-642c3535-be33-41b8-8389-91af29a70350 tempest-VolumeDependencyTests-1196851174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.info" returned: 0 in 0.673s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-642c3535-be33-41b8-8389-91af29a70350 tempest-VolumeDependencyTests-1196851174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.659s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:05:01 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.684s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:05:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d60fba-2f4e-445a-b8b9-0e88db4f35e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79d2061a7054d2c8a31a78d6802b72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:04:57Z,use_quota=True,user_id='911fb454f9984306b54ff5e7e2675af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:05:01 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Creating volume e9d60fba-2f4e-445a-b8b9-0e88db4f35e5 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:05:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:05:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:05:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:05:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:05:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:05:02 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:05:02 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:05:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:02 devstack sudo[114982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5 1073741824
Jun 26 06:05:02 devstack sudo[114982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:02 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-642c3535-be33-41b8-8389-91af29a70350 tempest-VolumeDependencyTests-1196851174 None] Create snapshot completed successfully
Jun 26 06:05:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1b73e176-b96f-41ea-88ce-bd2c6bfc80ac tempest-SnapshotDependencyTests-1278970603 None] Acquiring lock "cinder-eba791b6-b5cb-4890-9b46-8c0453a1aa0b-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1b73e176-b96f-41ea-88ce-bd2c6bfc80ac tempest-SnapshotDependencyTests-1278970603 None] Lock "cinder-eba791b6-b5cb-4890-9b46-8c0453a1aa0b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:02 devstack sudo[114976]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1b73e176-b96f-41ea-88ce-bd2c6bfc80ac tempest-SnapshotDependencyTests-1278970603 None] Acquiring lock "cinder-quobyte-eba791b6-b5cb-4890-9b46-8c0453a1aa0b" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-a4002d63-9510-4dfd-9159-692c50381b94 tempest-CreateVolumesFromImageTest-393902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.730s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:02 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-a4002d63-9510-4dfd-9159-692c50381b94 tempest-CreateVolumesFromImageTest-393902001 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:05:02 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-a4002d63-9510-4dfd-9159-692c50381b94 tempest-CreateVolumesFromImageTest-393902001 None] Deleted volume successfully.
Jun 26 06:05:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1b73e176-b96f-41ea-88ce-bd2c6bfc80ac tempest-SnapshotDependencyTests-1278970603 None] Lock "cinder-quobyte-eba791b6-b5cb-4890-9b46-8c0453a1aa0b" acquired by "delete_volume" :: waited 0.024s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:02 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-a4002d63-9510-4dfd-9159-692c50381b94 tempest-CreateVolumesFromImageTest-393902001 None] Lock "cinder-72a8b026-caf8-4544-a9d0-6b9514c4d501-delete_volume" released by "delete_volume" :: held 2.532s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:02 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[526816d1-fb65-48da-9b0a-d20a44258d94]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:05:02 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1b73e176-b96f-41ea-88ce-bd2c6bfc80ac tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:02 devstack sudo[114985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b
Jun 26 06:05:02 devstack sudo[114985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:03 devstack sudo[114982]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5 1073741824" returned: 0 in 1.066s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:03 devstack sudo[114991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5
Jun 26 06:05:03 devstack sudo[114991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Flow 'volume_create_manager' (6acf1238-e195-4c45-a77f-ccd2c79acbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (862641ba-2887-4f15-b0ef-ca8e900ff09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (862641ba-2887-4f15-b0ef-ca8e900ff09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2140041247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea1b070700a4ae9af28b14f063af032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=70bce8f6-5702-430c-bd96-d808ae18ffda,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:05:03Z,use_quota=True,user_id='7237cbc6ead94420ab8a2bf378b22480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec3bc0d-5ef1-4fc5-b0a1-5aa0e5673d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec3bc0d-5ef1-4fc5-b0a1-5aa0e5673d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b24fa3-26b3-403c-a892-353e8ccfc143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b24fa3-26b3-403c-a892-353e8ccfc143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d', 'volume_name': 'volume-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d', 'volume_size': 1, 'snapshot_id': '70bce8f6-5702-430c-bd96-d808ae18ffda'}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aebdf292-4b4f-4701-8eb4-0642a479d110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aebdf292-4b4f-4701-8eb4-0642a479d110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89c115d-0ea0-4b6f-97ff-6b13356d960c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:05:03 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Volume 63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d', 'volume_size': 1, 'snapshot_id': '70bce8f6-5702-430c-bd96-d808ae18ffda'}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1b73e176-b96f-41ea-88ce-bd2c6bfc80ac tempest-SnapshotDependencyTests-1278970603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b" returned: 0 in 1.011s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1b73e176-b96f-41ea-88ce-bd2c6bfc80ac tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:03 devstack sudo[114985]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:03 devstack sudo[114996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b
Jun 26 06:05:03 devstack sudo[114996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:03 devstack sudo[114991]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5" returned: 0 in 0.799s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.603s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Acquiring lock "cinder-quobyte-70bce8f6-5702-430c-bd96-d808ae18ffda-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d" by "_create_volume_from_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9b66df-87e9-411d-8a50-66a75127aca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d705783-b099-440a-a4b7-b4a83ecc64df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Lock "cinder-quobyte-70bce8f6-5702-430c-bd96-d808ae18ffda-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Creating volume 63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d from snapshot 70bce8f6-5702-430c-bd96-d808ae18ffda {{(pid=93708) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:05:03 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Acquiring lock "cinder-quobyte-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d" by "_copy_volume_from_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:04 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Volume volume-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5 (e9d60fba-2f4e-445a-b8b9-0e88db4f35e5): created successfully
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d705783-b099-440a-a4b7-b4a83ecc64df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Flow 'volume_create_manager' (a4019b9c-23c7-45c5-89d5-17b4241f77de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Lock "cinder-quobyte-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] snapshot: 70bce8f6-5702-430c-bd96-d808ae18ffda, volume: 63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d,  {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 26 06:05:04 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-b2723e02-26ad-46ad-aaa7-21313cc09eeb tempest-CinderUnicodeTest-470718677 None] Created volume successfully.
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[3772159d-f30e-425c-a9c9-94640358134e]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:04 devstack sudo[114996]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1b73e176-b96f-41ea-88ce-bd2c6bfc80ac tempest-SnapshotDependencyTests-1278970603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-eba791b6-b5cb-4890-9b46-8c0453a1aa0b" returned: 0 in 0.738s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1b73e176-b96f-41ea-88ce-bd2c6bfc80ac tempest-SnapshotDependencyTests-1278970603 None] Lock "cinder-quobyte-eba791b6-b5cb-4890-9b46-8c0453a1aa0b" released by "delete_volume" :: held 1.835s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:04 devstack sudo[115000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda
Jun 26 06:05:04 devstack sudo[115000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-1b73e176-b96f-41ea-88ce-bd2c6bfc80ac tempest-SnapshotDependencyTests-1278970603 None] Created reservations ['b61f46c2-c2cb-470a-82fa-bf852c87e7ae', '3ed0a893-0fcb-4fd7-b058-1d0fc92fef3a', '803e1775-c7e4-449d-b0c3-728ae5ed2155', 'd6e6f487-52fd-4a43-a89d-998e10901123'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1b73e176-b96f-41ea-88ce-bd2c6bfc80ac tempest-SnapshotDependencyTests-1278970603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1b73e176-b96f-41ea-88ce-bd2c6bfc80ac tempest-SnapshotDependencyTests-1278970603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-1b73e176-b96f-41ea-88ce-bd2c6bfc80ac tempest-SnapshotDependencyTests-1278970603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-1b73e176-b96f-41ea-88ce-bd2c6bfc80ac tempest-SnapshotDependencyTests-1278970603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1b73e176-b96f-41ea-88ce-bd2c6bfc80ac tempest-SnapshotDependencyTests-1278970603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1b73e176-b96f-41ea-88ce-bd2c6bfc80ac tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:04 devstack sudo[115004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:05:04 devstack sudo[115004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-77f7acf9-0a03-4a2a-9169-7da45f595ba7 tempest-SnapshotDependencyTests-1278970603 None] Acquiring lock "cinder-ace959ed-8744-4544-96f5-f19f1bfe726f-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-77f7acf9-0a03-4a2a-9169-7da45f595ba7 tempest-SnapshotDependencyTests-1278970603 None] Lock "cinder-ace959ed-8744-4544-96f5-f19f1bfe726f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-77f7acf9-0a03-4a2a-9169-7da45f595ba7 tempest-SnapshotDependencyTests-1278970603 None] Acquiring lock "cinder-quobyte-ace959ed-8744-4544-96f5-f19f1bfe726f" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-77f7acf9-0a03-4a2a-9169-7da45f595ba7 tempest-SnapshotDependencyTests-1278970603 None] Lock "cinder-quobyte-ace959ed-8744-4544-96f5-f19f1bfe726f" acquired by "delete_volume" :: waited 0.027s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c75a82-c294-4719-8d32-530e98763342]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:05:04 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-77f7acf9-0a03-4a2a-9169-7da45f595ba7 tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ace959ed-8744-4544-96f5-f19f1bfe726f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:04 devstack sudo[115006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ace959ed-8744-4544-96f5-f19f1bfe726f
Jun 26 06:05:04 devstack sudo[115006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:05 devstack sudo[115000]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda" returned: 0 in 1.061s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b130075f-e184-4a05-9909-dbb4fbaf3d49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49 {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Creating direct copy from snapshot {{(pid=93708) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc9042d-9f65-421b-97e6-1e20c006b035]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:05 devstack sudo[115004]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:05 devstack sudo[115011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1b73e176-b96f-41ea-88ce-bd2c6bfc80ac tempest-SnapshotDependencyTests-1278970603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.065s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:05 devstack sudo[115011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-1b73e176-b96f-41ea-88ce-bd2c6bfc80ac tempest-SnapshotDependencyTests-1278970603 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:05:05 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-1b73e176-b96f-41ea-88ce-bd2c6bfc80ac tempest-SnapshotDependencyTests-1278970603 None] Deleted volume successfully.
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1b73e176-b96f-41ea-88ce-bd2c6bfc80ac tempest-SnapshotDependencyTests-1278970603 None] Lock "cinder-eba791b6-b5cb-4890-9b46-8c0453a1aa0b-delete_volume" released by "delete_volume" :: held 3.181s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Flow 'volume_create_manager' (7ce5a2a7-fe69-410b-9fc6-8a5015e4535e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7185fa12-1689-48ad-a50b-764f7b551a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7185fa12-1689-48ad-a50b-764f7b551a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:05:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1791587861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f45a493-e194-46de-a110-820e8aefa83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79d2061a7054d2c8a31a78d6802b72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:05:05Z,use_quota=True,user_id='911fb454f9984306b54ff5e7e2675af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6a2ce2-f5c6-4159-a93e-0713e1b33020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6a2ce2-f5c6-4159-a93e-0713e1b33020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc098cbb-926e-4e03-8a5e-04f1d5ca1af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc098cbb-926e-4e03-8a5e-04f1d5ca1af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f45a493-e194-46de-a110-820e8aefa83c', 'volume_name': 'volume-7f45a493-e194-46de-a110-820e8aefa83c', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388338c2-e31c-435c-b0b8-fd1592a02b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388338c2-e31c-435c-b0b8-fd1592a02b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95802341-efd2-4ee8-9f38-96e82c5b7251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:05:05 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Volume 7f45a493-e194-46de-a110-820e8aefa83c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f45a493-e194-46de-a110-820e8aefa83c', 'volume_size': 1}
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:05:05 devstack sudo[115006]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-77f7acf9-0a03-4a2a-9169-7da45f595ba7 tempest-SnapshotDependencyTests-1278970603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ace959ed-8744-4544-96f5-f19f1bfe726f" returned: 0 in 1.009s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:05 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-77f7acf9-0a03-4a2a-9169-7da45f595ba7 tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ace959ed-8744-4544-96f5-f19f1bfe726f {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:05 devstack sudo[115017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ace959ed-8744-4544-96f5-f19f1bfe726f
Jun 26 06:05:05 devstack sudo[115017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:06 devstack sudo[115011]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49" returned: 0 in 0.972s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:06 devstack cinder-volume[93708]: DEBUG cinder.utils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Path /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d not found in is_blk_device check {{(pid=93708) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 26 06:05:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:06 devstack sudo[115022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d
Jun 26 06:05:06 devstack sudo[115022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:06 devstack sudo[115017]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-77f7acf9-0a03-4a2a-9169-7da45f595ba7 tempest-SnapshotDependencyTests-1278970603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-ace959ed-8744-4544-96f5-f19f1bfe726f" returned: 0 in 0.688s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:06 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-77f7acf9-0a03-4a2a-9169-7da45f595ba7 tempest-SnapshotDependencyTests-1278970603 None] Lock "cinder-quobyte-ace959ed-8744-4544-96f5-f19f1bfe726f" released by "delete_volume" :: held 1.768s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:06 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-77f7acf9-0a03-4a2a-9169-7da45f595ba7 tempest-SnapshotDependencyTests-1278970603 None] Created reservations ['1ffc90eb-4369-4ede-9d43-a1bf266ba810', '97db4265-7bca-41ac-970a-a76a95ac5356', '8256e20c-b745-4ee2-964f-e8c6265ecaca', '70937d54-0ed8-4807-b898-9cb2aa742ed9'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:05:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-77f7acf9-0a03-4a2a-9169-7da45f595ba7 tempest-SnapshotDependencyTests-1278970603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:05:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-77f7acf9-0a03-4a2a-9169-7da45f595ba7 tempest-SnapshotDependencyTests-1278970603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:05:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-77f7acf9-0a03-4a2a-9169-7da45f595ba7 tempest-SnapshotDependencyTests-1278970603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:05:06 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-77f7acf9-0a03-4a2a-9169-7da45f595ba7 tempest-SnapshotDependencyTests-1278970603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:05:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-77f7acf9-0a03-4a2a-9169-7da45f595ba7 tempest-SnapshotDependencyTests-1278970603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:05:06 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-77f7acf9-0a03-4a2a-9169-7da45f595ba7 tempest-SnapshotDependencyTests-1278970603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:06 devstack sudo[115025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:05:06 devstack sudo[115025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:07 devstack sudo[115025]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:07 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-77f7acf9-0a03-4a2a-9169-7da45f595ba7 tempest-SnapshotDependencyTests-1278970603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.246s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:07 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-77f7acf9-0a03-4a2a-9169-7da45f595ba7 tempest-SnapshotDependencyTests-1278970603 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:05:07 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-77f7acf9-0a03-4a2a-9169-7da45f595ba7 tempest-SnapshotDependencyTests-1278970603 None] Deleted volume successfully.
Jun 26 06:05:07 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-77f7acf9-0a03-4a2a-9169-7da45f595ba7 tempest-SnapshotDependencyTests-1278970603 None] Lock "cinder-ace959ed-8744-4544-96f5-f19f1bfe726f-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:10 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93708) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 26 06:05:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Flow 'volume_create_manager' (f9dc363f-7058-4a10-895a-3ec3fdb1881e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:05:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea30393-c1be-472f-97ba-deb3adfa10a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:05:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea30393-c1be-472f-97ba-deb3adfa10a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=866a2084-79a9-4eb4-81fa-f80c117bd4e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='529a6062266844e49051d5c066bd04f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:05:10Z,use_quota=True,user_id='95a7047c13864b76b443aceec50de435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:05:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b3fa39-857a-45d5-9ad5-5ae2a080a66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:05:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b3fa39-857a-45d5-9ad5-5ae2a080a66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:05:10 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86dfbc9-f04a-4293-b8c9-32c49ff12da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:05:10 devstack cinder-volume[93708]: DEBUG cinder.image.glance [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Creating Keystone auth plugin from conf {{(pid=93708) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 26 06:05:10 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 06:05:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:05:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:05:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:05:10 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:05:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:05:10 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:10 devstack sudo[115040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:05:10 devstack sudo[115040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86dfbc9-f04a-4293-b8c9-32c49ff12da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '866a2084-79a9-4eb4-81fa-f80c117bd4e9', 'volume_name': 'volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9', 'volume_size': 1, 'image_id': '9b8c2775-f187-49e8-ad02-4273aad7821d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b8c2775-f187-49e8-ad02-4273aad7821d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0f2d340700563898c0b811a80943c38a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '529a6062266844e49051d5c066bd04f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3250e26a5113f36dff2c80834250a18bc9fbd0490d307aebe69646e212bffd2911f6943adecee0b602d526ad8e5acda9f823b0145a7bf6940d7b0f3011b34ea', 'id': '9b8c2775-f187-49e8-ad02-4273aad7821d', 'created_at': datetime.datetime(2026, 6, 26, 4, 5, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 4, 5, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b8c2775-f187-49e8-ad02-4273aad7821d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf398b6690>}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:05:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b5af6b-8132-4809-bf20-674de5f22a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:05:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b5af6b-8132-4809-bf20-674de5f22a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:05:11 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08abf704-d994-444d-9ed3-bd516b541776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:05:11 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Volume 866a2084-79a9-4eb4-81fa-f80c117bd4e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9', 'volume_size': 1, 'image_id': '9b8c2775-f187-49e8-ad02-4273aad7821d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b8c2775-f187-49e8-ad02-4273aad7821d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0f2d340700563898c0b811a80943c38a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '529a6062266844e49051d5c066bd04f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3250e26a5113f36dff2c80834250a18bc9fbd0490d307aebe69646e212bffd2911f6943adecee0b602d526ad8e5acda9f823b0145a7bf6940d7b0f3011b34ea', 'id': '9b8c2775-f187-49e8-ad02-4273aad7821d', 'created_at': datetime.datetime(2026, 6, 26, 4, 5, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 4, 5, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b8c2775-f187-49e8-ad02-4273aad7821d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf398b6690>}
Jun 26 06:05:11 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Trying to clone 866a2084-79a9-4eb4-81fa-f80c117bd4e9 from image 9b8c2775-f187-49e8-ad02-4273aad7821d at location (None, [{'url': 'file:///opt/stack/data/glance/images/9b8c2775-f187-49e8-ad02-4273aad7821d', 'metadata': {}}]). {{(pid=93708) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 26 06:05:11 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 26 06:05:11 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Image download 0.00 MB at 0.00 MB/s
Jun 26 06:05:11 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[7669d8d5-32b1-41a8-bc02-4416674bd573]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:05:11 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:12 devstack sudo[115042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD
Jun 26 06:05:12 devstack sudo[115042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:12 devstack sudo[115022]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d" returned: 0 in 6.387s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:12 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f88f2f-8b35-4948-961a-3679d7a757bc]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:05:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:12 devstack sudo[115040]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:12 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 1.798s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:12 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:05:12 devstack cinder-volume[93708]: DEBUG oslo_service.periodic_task [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 06:05:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread count: 28 {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 26 06:05:12 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-79c11bdf-dcab-4927-967d-5f64760fe4d6 None None] thread info: [<_MainThread(MainThread, started 124035618852992)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124035508416320)>, <Thread(Thread-3 (stat_writer), started daemon 124035512804224)>, <Thread(Rabbit-heartbeat, started daemon 124035507478720)>, <Thread(Thread-5 (_runner), started daemon 124035505657856)>, <Thread(Thread-7 (_runner), started daemon 124035505678080)>, <Thread(fd_logger, started daemon 124035503806464)>, <Thread(privsep_reader, started daemon 124035503814272)>, <Thread(tpool_thread_0, started daemon 124035494721216)>, <Thread(tpool_thread_1, started daemon 124035486328512)>, <Thread(tpool_thread_2, started daemon 124035477919424)>, <Thread(tpool_thread_3, started daemon 124035469510336)>, <Thread(tpool_thread_4, started daemon 124035461101248)>, <Thread(tpool_thread_5, started daemon 124035452692160)>, <Thread(tpool_thread_6, started daemon 124035444283072)>, <Thread(tpool_thread_7, started daemon 124035435873984)>, <Thread(tpool_thread_8, started daemon 124035427464896)>, <Thread(tpool_thread_9, started daemon 124035419055808)>, <Thread(tpool_thread_10, started daemon 124035410646720)>, <Thread(tpool_thread_11, started daemon 124035402237632)>, <Thread(tpool_thread_12, started daemon 124035393828544)>, <Thread(tpool_thread_13, started daemon 124035385419456)>, <Thread(tpool_thread_14, started daemon 124035377010368)>, <Thread(tpool_thread_15, started daemon 124035368601280)>, <Thread(tpool_thread_16, started daemon 124035360192192)>, <Thread(tpool_thread_17, started daemon 124035351783104)>, <Thread(tpool_thread_18, started daemon 124035343374016)>, <Thread(tpool_thread_19, started daemon 124035334964928)>] {{(pid=93708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 26 06:05:12 devstack sudo[115046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49
Jun 26 06:05:12 devstack sudo[115046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:13 devstack sudo[115042]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD" returned: 0 in 1.163s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:13 devstack sudo[115050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD
Jun 26 06:05:13 devstack sudo[115050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:13 devstack sudo[115046]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49" returned: 0 in 1.108s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:13 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Image conversion details: src /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49, size 1024.00 MB, duration 6.39 sec, destination /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 06:05:13 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Converted 1024.00 MB image at 160.27 MB/s
Jun 26 06:05:13 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d is being set with open permissions: ugo+rw
Jun 26 06:05:13 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:13 devstack sudo[115055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d
Jun 26 06:05:13 devstack sudo[115055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:14 devstack sudo[115050]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD" returned: 1 in 0.924s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Temporary image 9b8c2775-f187-49e8-ad02-4273aad7821d is fetched for user 95a7047c13864b76b443aceec50de435. {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[3765b611-5cac-4715-b2ac-835a737037a7]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:14 devstack sudo[115061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD
Jun 26 06:05:14 devstack sudo[115061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:14 devstack sudo[115055]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d" returned: 0 in 0.725s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Lock "cinder-quobyte-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d" released by "_copy_volume_from_snapshot" :: held 10.396s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Lock "cinder-quobyte-70bce8f6-5702-430c-bd96-d808ae18ffda-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d" released by "_create_volume_from_snapshot" :: held 10.455s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.489s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.849s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:05:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1791587861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f45a493-e194-46de-a110-820e8aefa83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79d2061a7054d2c8a31a78d6802b72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:05:05Z,use_quota=True,user_id='911fb454f9984306b54ff5e7e2675af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Creating volume 7f45a493-e194-46de-a110-820e8aefa83c {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:05:14 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:14 devstack sudo[115065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c 1073741824
Jun 26 06:05:14 devstack sudo[115065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89c115d-0ea0-4b6f-97ff-6b13356d960c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d', 'volume_size': 1, 'snapshot_id': '70bce8f6-5702-430c-bd96-d808ae18ffda'}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc79361-6f13-4004-9b4c-d568a7d8a3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:05:14 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Volume volume-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d (63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d): created successfully
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc79361-6f13-4004-9b4c-d568a7d8a3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:05:14 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Flow 'volume_create_manager' (6acf1238-e195-4c45-a77f-ccd2c79acbfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:05:14 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-db5e06fa-fc09-4ec3-9281-86e23ff5f424 tempest-VolumeDependencyTests-1196851174 None] Created volume successfully.
Jun 26 06:05:14 devstack sudo[115061]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD" returned: 0 in 0.862s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:15 devstack sudo[115070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD
Jun 26 06:05:15 devstack sudo[115070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:15 devstack sudo[115065]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c 1073741824" returned: 0 in 0.980s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:15 devstack sudo[115076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c
Jun 26 06:05:15 devstack sudo[115076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:15 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] Acquiring lock "cinder-70bce8f6-5702-430c-bd96-d808ae18ffda-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:15 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] Lock "cinder-70bce8f6-5702-430c-bd96-d808ae18ffda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:15 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] Acquiring lock "cinder-quobyte-b130075f-e184-4a05-9909-dbb4fbaf3d49" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:15 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] Lock "cinder-quobyte-b130075f-e184-4a05-9909-dbb4fbaf3d49" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:15 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] Acquiring lock "cinder-quobyte-70bce8f6-5702-430c-bd96-d808ae18ffda" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:15 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] Lock "cinder-quobyte-70bce8f6-5702-430c-bd96-d808ae18ffda" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] Deleting offline snapshot 70bce8f6-5702-430c-bd96-d808ae18ffda of volume b130075f-e184-4a05-9909-dbb4fbaf3d49 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 06:05:15 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] snapshot_file for this snap is: volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 06:05:15 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9575440-b243-4aaf-b2b4-1ce6ae829597]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:05:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:15 devstack sudo[115078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda
Jun 26 06:05:15 devstack sudo[115078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:15 devstack sudo[115070]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD" returned: 1 in 0.949s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:05:15 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:05:16 devstack sudo[115076]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c" returned: 0 in 0.910s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:05:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.961s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:05:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.444s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:05:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70cf44ce08c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-26T04:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=866a2084-79a9-4eb4-81fa-f80c117bd4e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='529a6062266844e49051d5c066bd04f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T04:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T04:05:10Z,use_quota=True,user_id='95a7047c13864b76b443aceec50de435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe824ab-1758-4d85-bfcd-2aa051f3cd65),volume_type_id=cfe824ab-1758-4d85-bfcd-2aa051f3cd65)}" {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 26 06:05:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Creating volume 866a2084-79a9-4eb4-81fa-f80c117bd4e9 {{(pid=93708) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 26 06:05:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:05:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:05:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:05:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:05:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:05:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Selected osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85 as target Quobyte volume. {{(pid=93708) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 26 06:05:16 devstack cinder-volume[93708]: INFO cinder.volume.drivers.remotefs [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] casted to osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85
Jun 26 06:05:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9 1073741824 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95802341-efd2-4ee8-9f38-96e82c5b7251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f45a493-e194-46de-a110-820e8aefa83c', 'volume_size': 1}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:05:16 devstack sudo[115085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9 1073741824
Jun 26 06:05:16 devstack sudo[115085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93a0128-10cd-4c71-a3de-82afb94e6fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:05:16 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Volume volume-7f45a493-e194-46de-a110-820e8aefa83c (7f45a493-e194-46de-a110-820e8aefa83c): created successfully
Jun 26 06:05:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93a0128-10cd-4c71-a3de-82afb94e6fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:05:16 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Flow 'volume_create_manager' (7ce5a2a7-fe69-410b-9fc6-8a5015e4535e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:05:16 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-ce32b659-6da4-4661-940b-1bab9c2f5923 tempest-CinderUnicodeTest-470718677 None] Created volume successfully.
Jun 26 06:05:16 devstack sudo[115078]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda" returned: 0 in 0.881s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:16 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b130075f-e184-4a05-9909-dbb4fbaf3d49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 06:05:16 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfac1863-aee6-4801-9d7e-926016a2e051]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:05:16 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:16 devstack sudo[115090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49
Jun 26 06:05:16 devstack sudo[115090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-071e14cf-1c3b-48c8-8a67-efc9e89436a6 tempest-CinderUnicodeTest-470718677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:05:17 devstack sudo[115085]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9 1073741824" returned: 0 in 1.012s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:17 devstack sudo[115098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9
Jun 26 06:05:17 devstack sudo[115098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:17 devstack sudo[115090]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49" returned: 0 in 1.068s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:17 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:17 devstack sudo[115103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda
Jun 26 06:05:17 devstack sudo[115103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:18 devstack sudo[115098]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9" returned: 0 in 0.826s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'} {{(pid=93708) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 26 06:05:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:05:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-071e14cf-1c3b-48c8-8a67-efc9e89436a6 tempest-CinderUnicodeTest-470718677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.154s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:05:18 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-071e14cf-1c3b-48c8-8a67-efc9e89436a6 tempest-CinderUnicodeTest-470718677 None] Creating offline snapshot bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430 of volume 7f45a493-e194-46de-a110-820e8aefa83c {{(pid=93708) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 26 06:05:18 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c1e157-85ce-425e-9c29-75131b8e2c0f]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:05:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-071e14cf-1c3b-48c8-8a67-efc9e89436a6 tempest-CinderUnicodeTest-470718677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:18 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Attempting download of 9b8c2775-f187-49e8-ad02-4273aad7821d ((None, [{'url': 'file:///opt/stack/data/glance/images/9b8c2775-f187-49e8-ad02-4273aad7821d', 'metadata': {}}])) to volume 866a2084-79a9-4eb4-81fa-f80c117bd4e9. {{(pid=93708) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 26 06:05:18 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[374920dd-0ba3-48cb-845e-c91658fca4a4]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:05:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b8c2775-f187-49e8-ad02-4273aad7821d_n6loo5z0 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:18 devstack sudo[115106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c
Jun 26 06:05:18 devstack sudo[115106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:18 devstack sudo[115110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b8c2775-f187-49e8-ad02-4273aad7821d_n6loo5z0
Jun 26 06:05:18 devstack sudo[115110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:18 devstack sudo[115103]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda" returned: 0 in 1.024s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:18 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:18 devstack sudo[115115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda
Jun 26 06:05:18 devstack sudo[115115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:19 devstack sudo[115106]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-071e14cf-1c3b-48c8-8a67-efc9e89436a6 tempest-CinderUnicodeTest-470718677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c" returned: 0 in 0.994s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-071e14cf-1c3b-48c8-8a67-efc9e89436a6 tempest-CinderUnicodeTest-470718677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:19 devstack sudo[115123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430 1G
Jun 26 06:05:19 devstack sudo[115123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:19 devstack sudo[115110]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b8c2775-f187-49e8-ad02-4273aad7821d_n6loo5z0" returned: 0 in 0.989s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b8c2775-f187-49e8-ad02-4273aad7821d_n6loo5z0 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:19 devstack sudo[115115]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:19 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49.70bce8f6-5702-430c-bd96-d808ae18ffda" returned: 0 in 0.763s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:19 devstack sudo[115126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b8c2775-f187-49e8-ad02-4273aad7821d_n6loo5z0
Jun 26 06:05:19 devstack sudo[115126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] Lock "cinder-quobyte-70bce8f6-5702-430c-bd96-d808ae18ffda" released by "_delete_snapshot" :: held 3.899s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] Lock "cinder-quobyte-b130075f-e184-4a05-9909-dbb4fbaf3d49" released by "delete_snapshot" :: held 3.938s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:19 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] Created reservations ['05fbb0d6-4226-423d-9655-4a933cfccf8e', '77676198-2cef-4561-8ffa-ca5b7020f9a3', '736be466-9535-416d-96a4-ca6bc45c5a19', '93eba5a4-29a5-45f0-b440-212e4c6f6052'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:05:19 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] Delete snapshot completed successfully.
Jun 26 06:05:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8c4fafa9-d76d-42f0-baaa-17ed8e085563 tempest-VolumeDependencyTests-1196851174 None] Lock "cinder-70bce8f6-5702-430c-bd96-d808ae18ffda-delete_snapshot" released by "delete_snapshot" :: held 4.152s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:19 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-89880b8d-152a-4588-ba41-2c9d346117dd tempest-VolumeDependencyTests-1196851174 None] Acquiring lock "cinder-b130075f-e184-4a05-9909-dbb4fbaf3d49-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:20 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-89880b8d-152a-4588-ba41-2c9d346117dd tempest-VolumeDependencyTests-1196851174 None] Lock "cinder-b130075f-e184-4a05-9909-dbb4fbaf3d49-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:20 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-89880b8d-152a-4588-ba41-2c9d346117dd tempest-VolumeDependencyTests-1196851174 None] Acquiring lock "cinder-quobyte-b130075f-e184-4a05-9909-dbb4fbaf3d49" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:20 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-89880b8d-152a-4588-ba41-2c9d346117dd tempest-VolumeDependencyTests-1196851174 None] Lock "cinder-quobyte-b130075f-e184-4a05-9909-dbb4fbaf3d49" acquired by "delete_volume" :: waited 0.018s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:20 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[8589b883-4c9d-4897-9f4c-b563334371f6]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:05:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-89880b8d-152a-4588-ba41-2c9d346117dd tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:20 devstack sudo[115131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49
Jun 26 06:05:20 devstack sudo[115131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:20 devstack sudo[115126]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b8c2775-f187-49e8-ad02-4273aad7821d_n6loo5z0" returned: 1 in 0.909s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b8c2775-f187-49e8-ad02-4273aad7821d_n6loo5z0' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:05:20 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[606217d3-7fa6-4e07-93fe-19bb8b6e1c70]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:05:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:20 devstack sudo[115123]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-071e14cf-1c3b-48c8-8a67-efc9e89436a6 tempest-CinderUnicodeTest-470718677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430 1G" returned: 0 in 1.083s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:20 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-071e14cf-1c3b-48c8-8a67-efc9e89436a6 tempest-CinderUnicodeTest-470718677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f45a493-e194-46de-a110-820e8aefa83c -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:20 devstack sudo[115137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f45a493-e194-46de-a110-820e8aefa83c -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430
Jun 26 06:05:20 devstack sudo[115137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:20 devstack sudo[115136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD
Jun 26 06:05:20 devstack sudo[115136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:21 devstack sudo[115131]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-89880b8d-152a-4588-ba41-2c9d346117dd tempest-VolumeDependencyTests-1196851174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49" returned: 0 in 0.904s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-89880b8d-152a-4588-ba41-2c9d346117dd tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:21 devstack sudo[115144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49
Jun 26 06:05:21 devstack sudo[115144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:21 devstack sudo[115136]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD" returned: 0 in 0.916s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:21 devstack sudo[115137]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-071e14cf-1c3b-48c8-8a67-efc9e89436a6 tempest-CinderUnicodeTest-470718677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f45a493-e194-46de-a110-820e8aefa83c -F qcow2 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430" returned: 0 in 0.867s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:21 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-071e14cf-1c3b-48c8-8a67-efc9e89436a6 tempest-CinderUnicodeTest-470718677 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430 is being set with open permissions: ugo+rw
Jun 26 06:05:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-071e14cf-1c3b-48c8-8a67-efc9e89436a6 tempest-CinderUnicodeTest-470718677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:21 devstack sudo[115152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430
Jun 26 06:05:21 devstack sudo[115152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:21 devstack sudo[115151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD
Jun 26 06:05:21 devstack sudo[115151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:21 devstack sudo[115144]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-89880b8d-152a-4588-ba41-2c9d346117dd tempest-VolumeDependencyTests-1196851174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-b130075f-e184-4a05-9909-dbb4fbaf3d49" returned: 0 in 0.707s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:21 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-89880b8d-152a-4588-ba41-2c9d346117dd tempest-VolumeDependencyTests-1196851174 None] Lock "cinder-quobyte-b130075f-e184-4a05-9909-dbb4fbaf3d49" released by "delete_volume" :: held 1.698s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:21 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-89880b8d-152a-4588-ba41-2c9d346117dd tempest-VolumeDependencyTests-1196851174 None] Created reservations ['61dd8c02-e0ac-4bc4-b550-4c61d8aeeaaf', '2c4c0f3f-3490-4ce0-bc92-40a07d00eece', 'e7b3a462-2ca7-4fa1-b1ff-5be986a69e4e', '4fa913ab-44f0-4bda-adba-56f11a88b7a9'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:05:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-89880b8d-152a-4588-ba41-2c9d346117dd tempest-VolumeDependencyTests-1196851174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:05:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-89880b8d-152a-4588-ba41-2c9d346117dd tempest-VolumeDependencyTests-1196851174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:05:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-89880b8d-152a-4588-ba41-2c9d346117dd tempest-VolumeDependencyTests-1196851174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:05:21 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-89880b8d-152a-4588-ba41-2c9d346117dd tempest-VolumeDependencyTests-1196851174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:05:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-89880b8d-152a-4588-ba41-2c9d346117dd tempest-VolumeDependencyTests-1196851174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:05:21 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-89880b8d-152a-4588-ba41-2c9d346117dd tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:21 devstack sudo[115160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:05:21 devstack sudo[115160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:22 devstack sudo[115152]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-071e14cf-1c3b-48c8-8a67-efc9e89436a6 tempest-CinderUnicodeTest-470718677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430" returned: 0 in 0.673s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:22 devstack sudo[115151]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD" returned: 1 in 0.730s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:05:22 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] 9b8c2775-f187-49e8-ad02-4273aad7821d was raw, converting to raw {{(pid=93708) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 26 06:05:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-071e14cf-1c3b-48c8-8a67-efc9e89436a6 tempest-CinderUnicodeTest-470718677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:22 devstack sudo[115162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9
Jun 26 06:05:22 devstack sudo[115162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:22 devstack sudo[115163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.info
Jun 26 06:05:22 devstack sudo[115163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:22 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-17c5006d-5f68-4566-9372-05fe772cae6f tempest-VolumeDependencyTests-1196851174 None] Acquiring lock "cinder-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:22 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-17c5006d-5f68-4566-9372-05fe772cae6f tempest-VolumeDependencyTests-1196851174 None] Lock "cinder-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:22 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-17c5006d-5f68-4566-9372-05fe772cae6f tempest-VolumeDependencyTests-1196851174 None] Acquiring lock "cinder-quobyte-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:22 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-17c5006d-5f68-4566-9372-05fe772cae6f tempest-VolumeDependencyTests-1196851174 None] Lock "cinder-quobyte-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d" acquired by "delete_volume" :: waited 0.017s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:22 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecba94c-5981-46dd-ab69-96270d778164]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:05:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-17c5006d-5f68-4566-9372-05fe772cae6f tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:22 devstack sudo[115160]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-89880b8d-152a-4588-ba41-2c9d346117dd tempest-VolumeDependencyTests-1196851174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.707s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:22 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-89880b8d-152a-4588-ba41-2c9d346117dd tempest-VolumeDependencyTests-1196851174 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:05:22 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-89880b8d-152a-4588-ba41-2c9d346117dd tempest-VolumeDependencyTests-1196851174 None] Deleted volume successfully.
Jun 26 06:05:22 devstack sudo[115168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d
Jun 26 06:05:22 devstack sudo[115168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:22 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-89880b8d-152a-4588-ba41-2c9d346117dd tempest-VolumeDependencyTests-1196851174 None] Lock "cinder-b130075f-e184-4a05-9909-dbb4fbaf3d49-delete_volume" released by "delete_volume" :: held 2.636s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:22 devstack sudo[115163]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-071e14cf-1c3b-48c8-8a67-efc9e89436a6 tempest-CinderUnicodeTest-470718677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.info" returned: 0 in 0.768s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:22 devstack cinder-volume[93708]: WARNING cinder.volume.drivers.remotefs [None req-071e14cf-1c3b-48c8-8a67-efc9e89436a6 tempest-CinderUnicodeTest-470718677 None] /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.info is being set with open permissions: ugo+rw
Jun 26 06:05:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-071e14cf-1c3b-48c8-8a67-efc9e89436a6 tempest-CinderUnicodeTest-470718677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.info {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:22 devstack sudo[115174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.info
Jun 26 06:05:22 devstack sudo[115174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:22 devstack sudo[115162]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9" returned: 0 in 0.840s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:22 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9b8c2775-f187-49e8-ad02-4273aad7821d_tykz4zfqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9 {{(pid=93708) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 26 06:05:22 devstack cinder-volume[93708]: INFO cinder.image.image_utils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Converted 0.00 MB image at 0.00 MB/s
Jun 26 06:05:22 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9 1G {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:22 devstack sudo[115176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9 1G
Jun 26 06:05:22 devstack sudo[115176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:23 devstack sudo[115168]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-17c5006d-5f68-4566-9372-05fe772cae6f tempest-VolumeDependencyTests-1196851174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d" returned: 0 in 0.830s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-17c5006d-5f68-4566-9372-05fe772cae6f tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:23 devstack sudo[115183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d
Jun 26 06:05:23 devstack sudo[115183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:23 devstack sudo[115174]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-071e14cf-1c3b-48c8-8a67-efc9e89436a6 tempest-CinderUnicodeTest-470718677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.info" returned: 0 in 0.743s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-071e14cf-1c3b-48c8-8a67-efc9e89436a6 tempest-CinderUnicodeTest-470718677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.280s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:05:23 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-071e14cf-1c3b-48c8-8a67-efc9e89436a6 tempest-CinderUnicodeTest-470718677 None] Create snapshot completed successfully
Jun 26 06:05:23 devstack sudo[115176]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9 1G" returned: 0 in 0.775s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:23 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[670a5a27-8762-4b12-b2a4-7171202505ac]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:05:23 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:23 devstack sudo[115189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9
Jun 26 06:05:23 devstack sudo[115189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:24 devstack sudo[115183]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-17c5006d-5f68-4566-9372-05fe772cae6f tempest-VolumeDependencyTests-1196851174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d" returned: 0 in 0.676s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-17c5006d-5f68-4566-9372-05fe772cae6f tempest-VolumeDependencyTests-1196851174 None] Lock "cinder-quobyte-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d" released by "delete_volume" :: held 1.562s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-17c5006d-5f68-4566-9372-05fe772cae6f tempest-VolumeDependencyTests-1196851174 None] Created reservations ['cda2ca03-0b67-4091-9083-3b4800f6dabc', 'b6a5cf90-da65-4006-8649-68a922462c67', '4acdf645-e0f6-473f-a27b-8e87286dddb2', 'c09e9f8e-97bf-490e-976b-44aa14e54586'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-17c5006d-5f68-4566-9372-05fe772cae6f tempest-VolumeDependencyTests-1196851174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-17c5006d-5f68-4566-9372-05fe772cae6f tempest-VolumeDependencyTests-1196851174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-17c5006d-5f68-4566-9372-05fe772cae6f tempest-VolumeDependencyTests-1196851174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-17c5006d-5f68-4566-9372-05fe772cae6f tempest-VolumeDependencyTests-1196851174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-17c5006d-5f68-4566-9372-05fe772cae6f tempest-VolumeDependencyTests-1196851174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-17c5006d-5f68-4566-9372-05fe772cae6f tempest-VolumeDependencyTests-1196851174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:24 devstack sudo[115192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:05:24 devstack sudo[115192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:24 devstack sudo[115189]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9" returned: 0 in 0.759s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] Acquiring lock "cinder-bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430-delete_snapshot" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:24 devstack sudo[115196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9
Jun 26 06:05:24 devstack sudo[115196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] Lock "cinder-bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] Acquiring lock "cinder-quobyte-7f45a493-e194-46de-a110-820e8aefa83c" by "delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] Lock "cinder-quobyte-7f45a493-e194-46de-a110-820e8aefa83c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] Acquiring lock "cinder-quobyte-bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430" by "_delete_snapshot" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] Lock "cinder-quobyte-bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] Deleting offline snapshot bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430 of volume 7f45a493-e194-46de-a110-820e8aefa83c {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] snapshot_file for this snap is: volume-7f45a493-e194-46de-a110-820e8aefa83c.bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430 {{(pid=93708) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6818937-a6ca-45c1-aa13-e9d3b97a40af]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:24 devstack sudo[115198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430
Jun 26 06:05:24 devstack sudo[115198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:24 devstack sudo[115192]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-17c5006d-5f68-4566-9372-05fe772cae6f tempest-VolumeDependencyTests-1196851174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.740s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-17c5006d-5f68-4566-9372-05fe772cae6f tempest-VolumeDependencyTests-1196851174 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:05:24 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-17c5006d-5f68-4566-9372-05fe772cae6f tempest-VolumeDependencyTests-1196851174 None] Deleted volume successfully.
Jun 26 06:05:24 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-17c5006d-5f68-4566-9372-05fe772cae6f tempest-VolumeDependencyTests-1196851174 None] Lock "cinder-63bfa5ba-7bdd-41e6-a80a-acf68ec1de5d-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:25 devstack sudo[115196]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9" returned: 1 in 0.809s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:05:25 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Downloaded image 9b8c2775-f187-49e8-ad02-4273aad7821d ((None, [{'url': 'file:///opt/stack/data/glance/images/9b8c2775-f187-49e8-ad02-4273aad7821d', 'metadata': {}}])) to volume 866a2084-79a9-4eb4-81fa-f80c117bd4e9 successfully. {{(pid=93708) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 26 06:05:25 devstack cinder-volume[93708]: DEBUG cinder.image.image_utils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Temporary image 9b8c2775-f187-49e8-ad02-4273aad7821d for user 95a7047c13864b76b443aceec50de435 is deleted. {{(pid=93708) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 26 06:05:25 devstack cinder-volume[93708]: DEBUG cinder.volume.volume_utils [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Marking volume 866a2084-79a9-4eb4-81fa-f80c117bd4e9 as bootable. {{(pid=93708) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 26 06:05:25 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Copying metadata from image 9b8c2775-f187-49e8-ad02-4273aad7821d to 866a2084-79a9-4eb4-81fa-f80c117bd4e9. {{(pid=93708) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 26 06:05:25 devstack cinder-volume[93708]: DEBUG cinder.volume.flows.manager.create_volume [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Creating volume glance metadata for volume 866a2084-79a9-4eb4-81fa-f80c117bd4e9 backed by image 9b8c2775-f187-49e8-ad02-4273aad7821d with: {'image_id': '9b8c2775-f187-49e8-ad02-4273aad7821d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0f2d340700563898c0b811a80943c38a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93708) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 26 06:05:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08abf704-d994-444d-9ed3-bd516b541776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9', 'volume_size': 1, 'image_id': '9b8c2775-f187-49e8-ad02-4273aad7821d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b8c2775-f187-49e8-ad02-4273aad7821d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0f2d340700563898c0b811a80943c38a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '529a6062266844e49051d5c066bd04f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3250e26a5113f36dff2c80834250a18bc9fbd0490d307aebe69646e212bffd2911f6943adecee0b602d526ad8e5acda9f823b0145a7bf6940d7b0f3011b34ea', 'id': '9b8c2775-f187-49e8-ad02-4273aad7821d', 'created_at': datetime.datetime(2026, 6, 26, 4, 5, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 4, 5, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b8c2775-f187-49e8-ad02-4273aad7821d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70cf398b6690>}' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:05:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722afd7b-5a29-4417-af6b-7b1f8ba6b72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 26 06:05:25 devstack cinder-volume[93708]: INFO cinder.volume.flows.manager.create_volume [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Volume volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9 (866a2084-79a9-4eb4-81fa-f80c117bd4e9): created successfully
Jun 26 06:05:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722afd7b-5a29-4417-af6b-7b1f8ba6b72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93708) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 26 06:05:25 devstack cinder-volume[93708]: DEBUG cinder.volume.manager [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Flow 'volume_create_manager' (f9dc363f-7058-4a10-895a-3ec3fdb1881e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93708) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 26 06:05:25 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-966094d1-2e55-40c1-842d-8a8cf833f447 tempest-VolumeImageDependencyTests-1948393204 None] Created volume successfully.
Jun 26 06:05:25 devstack sudo[115198]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430" returned: 0 in 0.869s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:25 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.remotefs [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f45a493-e194-46de-a110-820e8aefa83c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93708) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 26 06:05:25 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f1f9bc-9b42-434b-874d-1bdf9cb5a54d]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:05:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:25 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] Acquiring lock "cinder-866a2084-79a9-4eb4-81fa-f80c117bd4e9-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:25 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] Lock "cinder-866a2084-79a9-4eb4-81fa-f80c117bd4e9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:25 devstack sudo[115207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c
Jun 26 06:05:25 devstack sudo[115207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:25 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] Acquiring lock "cinder-quobyte-866a2084-79a9-4eb4-81fa-f80c117bd4e9" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:25 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] Lock "cinder-quobyte-866a2084-79a9-4eb4-81fa-f80c117bd4e9" acquired by "delete_volume" :: waited 0.026s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:25 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cb3c7c-ee67-45da-87f0-9546cfdc5b93]: (4, 'raw') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:05:25 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:25 devstack sudo[115209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9
Jun 26 06:05:25 devstack sudo[115209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:26 devstack sudo[115207]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c" returned: 0 in 0.906s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:26 devstack sudo[115215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430
Jun 26 06:05:26 devstack sudo[115215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:26 devstack sudo[115209]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9" returned: 0 in 0.818s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:26 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:26 devstack sudo[115218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9
Jun 26 06:05:26 devstack sudo[115218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:27 devstack sudo[115215]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430" returned: 0 in 0.754s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:27 devstack sudo[115223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430
Jun 26 06:05:27 devstack sudo[115223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:27 devstack sudo[115218]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9" returned: 1 in 0.792s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9' failed. Not Retrying. {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 06:05:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:27 devstack sudo[115228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9
Jun 26 06:05:27 devstack sudo[115228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:27 devstack sudo[115223]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:27 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c.bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430" returned: 0 in 0.643s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:27 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] Lock "cinder-quobyte-bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430" released by "_delete_snapshot" :: held 3.328s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:28 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] Lock "cinder-quobyte-7f45a493-e194-46de-a110-820e8aefa83c" released by "delete_snapshot" :: held 3.367s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:28 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] Created reservations ['a8acd6ab-aa03-458d-8588-2290fdb949fd', 'c23e9046-3e22-48fa-ba90-841da4adbefa', 'd8f6ce13-9497-4775-8112-bc91d31ee487', 'a96e61ac-bbd5-49bd-8b11-ce6308128b5c'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:05:28 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] Delete snapshot completed successfully.
Jun 26 06:05:28 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-c07afc2d-7fdd-45ec-87ec-ca95d2dce677 tempest-CinderUnicodeTest-470718677 None] Lock "cinder-bc528e17-cb0c-4ea1-9bbc-f47a5dd2f430-delete_snapshot" released by "delete_snapshot" :: held 3.512s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:28 devstack sudo[115228]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-866a2084-79a9-4eb4-81fa-f80c117bd4e9" returned: 0 in 0.675s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:28 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] Lock "cinder-quobyte-866a2084-79a9-4eb4-81fa-f80c117bd4e9" released by "delete_volume" :: held 2.368s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:28 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] Created reservations ['bdd8a21c-9bc0-4e4f-acad-9a3dfc2d2704', 'aca75c68-ce30-407f-81fd-38415392c769', 'b8cbd7d3-a50a-41b1-af83-c6367c8bf14c', '337756fa-542d-425d-ae71-3fa7e32de1e1'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:05:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:05:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:05:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:05:28 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:05:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:05:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:28 devstack sudo[115232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:05:28 devstack sudo[115232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:28 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8ae7cf31-bae9-4eef-b91e-99ba3a68ada0 tempest-CinderUnicodeTest-470718677 None] Acquiring lock "cinder-7f45a493-e194-46de-a110-820e8aefa83c-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:28 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8ae7cf31-bae9-4eef-b91e-99ba3a68ada0 tempest-CinderUnicodeTest-470718677 None] Lock "cinder-7f45a493-e194-46de-a110-820e8aefa83c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:28 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8ae7cf31-bae9-4eef-b91e-99ba3a68ada0 tempest-CinderUnicodeTest-470718677 None] Acquiring lock "cinder-quobyte-7f45a493-e194-46de-a110-820e8aefa83c" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:28 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8ae7cf31-bae9-4eef-b91e-99ba3a68ada0 tempest-CinderUnicodeTest-470718677 None] Lock "cinder-quobyte-7f45a493-e194-46de-a110-820e8aefa83c" acquired by "delete_volume" :: waited 0.015s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:28 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad4f482-bcd6-4678-b6c0-7e10007d9f36]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:05:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8ae7cf31-bae9-4eef-b91e-99ba3a68ada0 tempest-CinderUnicodeTest-470718677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:28 devstack sudo[115232]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:28 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.658s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:28 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:05:28 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] Deleted volume successfully.
Jun 26 06:05:28 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-0ed1f71d-c13e-411e-9033-df41d28f6537 tempest-VolumeImageDependencyTests-1948393204 None] Lock "cinder-866a2084-79a9-4eb4-81fa-f80c117bd4e9-delete_volume" released by "delete_volume" :: held 3.237s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:29 devstack sudo[115235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c
Jun 26 06:05:29 devstack sudo[115235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:29 devstack sudo[115235]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8ae7cf31-bae9-4eef-b91e-99ba3a68ada0 tempest-CinderUnicodeTest-470718677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c" returned: 0 in 0.783s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:29 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8ae7cf31-bae9-4eef-b91e-99ba3a68ada0 tempest-CinderUnicodeTest-470718677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:29 devstack sudo[115240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c
Jun 26 06:05:29 devstack sudo[115240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:30 devstack sudo[115240]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8ae7cf31-bae9-4eef-b91e-99ba3a68ada0 tempest-CinderUnicodeTest-470718677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-7f45a493-e194-46de-a110-820e8aefa83c" returned: 0 in 0.754s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:30 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8ae7cf31-bae9-4eef-b91e-99ba3a68ada0 tempest-CinderUnicodeTest-470718677 None] Lock "cinder-quobyte-7f45a493-e194-46de-a110-820e8aefa83c" released by "delete_volume" :: held 1.597s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:30 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-8ae7cf31-bae9-4eef-b91e-99ba3a68ada0 tempest-CinderUnicodeTest-470718677 None] Created reservations ['d0784f82-3e3a-4d91-aa06-afa2cf72599b', '1cc32ea6-0138-4c14-9a04-0fe77500e13b', 'c4f16016-add9-40eb-84f7-306e71257c2f', '0b9f4c63-d503-4c82-ac6c-61fa5faa11dc'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:05:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8ae7cf31-bae9-4eef-b91e-99ba3a68ada0 tempest-CinderUnicodeTest-470718677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:05:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8ae7cf31-bae9-4eef-b91e-99ba3a68ada0 tempest-CinderUnicodeTest-470718677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:05:30 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8ae7cf31-bae9-4eef-b91e-99ba3a68ada0 tempest-CinderUnicodeTest-470718677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:05:30 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-8ae7cf31-bae9-4eef-b91e-99ba3a68ada0 tempest-CinderUnicodeTest-470718677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:05:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-8ae7cf31-bae9-4eef-b91e-99ba3a68ada0 tempest-CinderUnicodeTest-470718677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:05:30 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8ae7cf31-bae9-4eef-b91e-99ba3a68ada0 tempest-CinderUnicodeTest-470718677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:30 devstack sudo[115243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:05:30 devstack sudo[115243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1a12720a-97d1-4f40-9f8a-8e5735bcf521 tempest-CinderUnicodeTest-470718677 None] Acquiring lock "cinder-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5-delete_volume" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1a12720a-97d1-4f40-9f8a-8e5735bcf521 tempest-CinderUnicodeTest-470718677 None] Lock "cinder-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1a12720a-97d1-4f40-9f8a-8e5735bcf521 tempest-CinderUnicodeTest-470718677 None] Acquiring lock "cinder-quobyte-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5" by "delete_volume" {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 26 06:05:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1a12720a-97d1-4f40-9f8a-8e5735bcf521 tempest-CinderUnicodeTest-470718677 None] Lock "cinder-quobyte-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5" acquired by "delete_volume" :: waited 0.016s {{(pid=93708) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 26 06:05:31 devstack cinder-volume[93708]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b11456-0891-4a4f-a92b-a824d49b4416]: (4, 'qcow2') {{(pid=94841) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 26 06:05:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1a12720a-97d1-4f40-9f8a-8e5735bcf521 tempest-CinderUnicodeTest-470718677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:31 devstack sudo[115246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5
Jun 26 06:05:31 devstack sudo[115246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:31 devstack sudo[115243]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-8ae7cf31-bae9-4eef-b91e-99ba3a68ada0 tempest-CinderUnicodeTest-470718677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.673s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:31 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-8ae7cf31-bae9-4eef-b91e-99ba3a68ada0 tempest-CinderUnicodeTest-470718677 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:05:31 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-8ae7cf31-bae9-4eef-b91e-99ba3a68ada0 tempest-CinderUnicodeTest-470718677 None] Deleted volume successfully.
Jun 26 06:05:31 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-8ae7cf31-bae9-4eef-b91e-99ba3a68ada0 tempest-CinderUnicodeTest-470718677 None] Lock "cinder-7f45a493-e194-46de-a110-820e8aefa83c-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:31 devstack sudo[115246]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1a12720a-97d1-4f40-9f8a-8e5735bcf521 tempest-CinderUnicodeTest-470718677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5" returned: 0 in 0.747s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:31 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1a12720a-97d1-4f40-9f8a-8e5735bcf521 tempest-CinderUnicodeTest-470718677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:31 devstack sudo[115251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5
Jun 26 06:05:31 devstack sudo[115251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:32 devstack sudo[115251]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1a12720a-97d1-4f40-9f8a-8e5735bcf521 tempest-CinderUnicodeTest-470718677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87/volume-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5" returned: 0 in 0.633s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:32 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1a12720a-97d1-4f40-9f8a-8e5735bcf521 tempest-CinderUnicodeTest-470718677 None] Lock "cinder-quobyte-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5" released by "delete_volume" :: held 1.418s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:32 devstack cinder-volume[93708]: DEBUG cinder.quota [None req-1a12720a-97d1-4f40-9f8a-8e5735bcf521 tempest-CinderUnicodeTest-470718677 None] Created reservations ['2bf9ed36-9244-4897-b2bc-b054ae653867', '54627bf8-8eba-4cf5-bf67-2252fe74132c', 'a69739bc-e37a-405f-bc54-8d70b09f5a0e', 'd660a86a-b808-4de0-8c7d-98d45ba0dbcc'] {{(pid=93708) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 26 06:05:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1a12720a-97d1-4f40-9f8a-8e5735bcf521 tempest-CinderUnicodeTest-470718677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 06:05:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1a12720a-97d1-4f40-9f8a-8e5735bcf521 tempest-CinderUnicodeTest-470718677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 06:05:32 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-1a12720a-97d1-4f40-9f8a-8e5735bcf521 tempest-CinderUnicodeTest-470718677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85': None} {{(pid=93708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 26 06:05:32 devstack cinder-volume[93708]: DEBUG cinder.volume.drivers.quobyte [None req-1a12720a-97d1-4f40-9f8a-8e5735bcf521 tempest-CinderUnicodeTest-470718677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0d5df13c-06e2-4d31-b50f-d7756f28da85'] {{(pid=93708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 26 06:05:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.lockutils [None req-1a12720a-97d1-4f40-9f8a-8e5735bcf521 tempest-CinderUnicodeTest-470718677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 06:05:32 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1a12720a-97d1-4f40-9f8a-8e5735bcf521 tempest-CinderUnicodeTest-470718677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87 {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 06:05:32 devstack sudo[115255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87
Jun 26 06:05:32 devstack sudo[115255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 26 06:05:33 devstack sudo[115255]: pam_unix(sudo:session): session closed for user root
Jun 26 06:05:33 devstack cinder-volume[93708]: DEBUG oslo_concurrency.processutils [None req-1a12720a-97d1-4f40-9f8a-8e5735bcf521 tempest-CinderUnicodeTest-470718677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37125100336cecf10961d670b3824d87" returned: 0 in 0.633s {{(pid=93708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 06:05:33 devstack cinder-volume[93708]: DEBUG cinder.manager [None req-1a12720a-97d1-4f40-9f8a-8e5735bcf521 tempest-CinderUnicodeTest-470718677 None] Notifying Schedulers of capabilities ... {{(pid=93708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 26 06:05:33 devstack cinder-volume[93708]: INFO cinder.volume.manager [None req-1a12720a-97d1-4f40-9f8a-8e5735bcf521 tempest-CinderUnicodeTest-470718677 None] Deleted volume successfully.
Jun 26 06:05:33 devstack cinder-volume[93708]: DEBUG cinder.coordination [None req-1a12720a-97d1-4f40-9f8a-8e5735bcf521 tempest-CinderUnicodeTest-470718677 None] Lock "cinder-e9d60fba-2f4e-445a-b8b9-0e88db4f35e5-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=93708) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 26 06:05:42 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:SELECT=87,cinder:INSERT=32,cinder:UPDATE=107,cinder:DELETE=12 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 26 06:05:43 devstack cinder-volume[93708]: DEBUG dbcounter [-] [93708] Writing DB stats cinder:UPDATE=123,cinder:SELECT=89,cinder:DELETE=6,cinder:INSERT=34 {{(pid=93708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}